Sep 01 01:55:41 devstack cinder-volume[76288]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 01:55:41 devstack cinder-volume[76288]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 01:55:41 devstack cinder-volume[76288]: we strongly recommend against using it for new projects. Sep 01 01:55:41 devstack cinder-volume[76288]: If you are already using Eventlet, we recommend migrating to a different Sep 01 01:55:41 devstack cinder-volume[76288]: framework. For more detail see Sep 01 01:55:41 devstack cinder-volume[76288]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 01:55:41 devstack cinder-volume[76288]: import eventlet # noqa Sep 01 01:55:44 devstack cinder-volume[76288]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 01:55:44 devstack cinder-volume[76288]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 01:55:44 devstack cinder-volume[76288]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 01:55:45 devstack cinder-volume[76288]: INFO dbcounter [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Registered counter for database cinder Sep 01 01:55:45 devstack cinder-volume[76288]: DEBUG oslo_db.sqlalchemy.engines [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76288) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:55:46 devstack cinder-volume[76288]: DEBUG dbcounter [-] [76288] Writer thread running {{(pid=76288) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:55:46 devstack cinder-volume[76288]: INFO cinder.rpc [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 01:55:46 devstack cinder-volume[76288]: INFO cinder.rpc [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 01:55:46 devstack cinder-volume[76288]: DEBUG oslo_db.sqlalchemy.engines [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76288) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:55:46 devstack cinder-volume[76288]: INFO cinder.volume.manager [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Determined volume DB was empty at startup. Sep 01 01:55:46 devstack cinder-volume[76288]: DEBUG cinder.volume.manager [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76288) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 01:55:46 devstack cinder-volume[76288]: INFO cinder.volume.manager [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 01:55:46 devstack cinder-volume[76288]: WARNING stevedore.named [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:55:46 devstack cinder-volume[76288]: WARNING castellan.key_manager [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:55:46 devstack cinder-volume[76288]: WARNING cinder.keymgr.conf_key_mgr [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:55:46 devstack cinder-volume[76288]: DEBUG cinder.volume.drivers.lvm [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76288) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 01 01:55:46 devstack cinder-volume[76288]: DEBUG oslo_concurrency.processutils [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:46 devstack cinder-volume[76288]: DEBUG oslo_concurrency.processutils [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] CMD "cinder-rtstool verify" returned: 0 in 0.454s {{(pid=76288) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_db.sqlalchemy.engines [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76288) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:55:47 devstack cinder-volume[76288]: INFO cinder.rpc [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 01 01:55:47 devstack cinder-volume[76288]: INFO cinder.rpc [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 01 01:55:47 devstack cinder-volume[76288]: WARNING stevedore.named [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 01:55:47 devstack cinder-volume[76288]: WARNING castellan.key_manager [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 01:55:47 devstack cinder-volume[76288]: INFO cinder.volume.manager [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_db.sqlalchemy.engines [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76288) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:55:47 devstack cinder-volume[76288]: INFO oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Starting 1 workers Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Started child 76550 {{(pid=76288) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Full set of CONF: {{(pid=76288) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] ******************************************************************************** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Configuration options gathered from: {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] ================================================================================ {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] allow_availability_zone_fallback = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] allow_compression_on_image_upload = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] allowed_direct_url_schemes = [] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] api_rate_limit = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] auth_strategy = keystone {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] az_cache_duration = 3600 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_availability_zone = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_host = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_name = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_stats_polling_interval = 60 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76550]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backup_api_class = cinder.backup.api.API {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backup_name_template = backup-%s {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backup_use_same_host = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backup_use_temp_snapshot = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] chap_password = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] chap_username = {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cinder_internal_tenant_project_id = 39a560deb77f473495d0b68721c8e1f8 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cinder_internal_tenant_user_id = a0432939d80847d4af57d915f4e3ab39 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cloned_volume_same_az = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cluster = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] compression_format = gzip {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] compute_api_class = cinder.compute.nova.API {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] config_dir = [] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] config_source = [] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] control_exchange = openstack {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] debug = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] default_availability_zone = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] default_group_type = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] default_volume_type = lvmdriver-1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] disk_geometry = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] driver_client_cert = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] driver_client_cert_key = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] driver_data_namespace = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] driver_ssl_cert_path = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] driver_ssl_cert_verify = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] driver_use_ssl = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] enable_force_upload = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] enable_new_services = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] enable_unsupported_driver = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] enforce_multipath_for_image_xfer = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] filter_function = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance_api_insecure = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance_api_servers = ['http://192.168.122.72/image'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance_api_ssl_compression = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance_ca_certificates_file = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance_catalog_info = image:glance:publicURL {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance_certfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance_keyfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance_num_retries = 3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance_request_timeout = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] goodness_function = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] graceful_shutdown_timeout = 5 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] group_api_class = cinder.group.api.API {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] host = devstack {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] image_compress_on_upload = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] image_conversion_address_space_limit = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] image_conversion_cpu_limit = 60 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] image_conversion_disable = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] image_upload_use_cinder_backend = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] image_upload_use_internal_tenant = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] image_volume_cache_enabled = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] image_volume_cache_max_count = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] image_volume_cache_max_size_gb = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] init_host_max_objects_retrieval = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] instance_format = [instance: %(uuid)s] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] iscsi_target_flags = {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] iscsi_write_cache = on {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] iser_helper = tgtadm {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] iser_ip_address = 192.168.122.72 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] iser_port = 3260 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] log_color = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] log_config_append = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76550]: INFO cinder.volume.manager [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] log_dir = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] log_file = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] log_options = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] log_rotate_interval = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] log_rotate_interval_type = days {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] log_rotation_type = none {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] max_age = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] max_logfile_count = 30 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] max_logfile_size_mb = 200 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] max_over_subscription_ratio = 20.0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] message_reap_interval = 86400 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] message_ttl = 2592000 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] migration_create_volume_timeout_secs = 300 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] monkey_patch = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] monkey_patch_modules = [] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] my_ip = 192.168.122.72 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] no_snapshot_gb_quota = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] num_iser_scan_tries = 3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] num_shell_tries = 3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] num_volume_device_scan_tries = 3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] nvmeof_conn_info_version = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] nvmet_ns_id = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] nvmet_port_id = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] osapi_max_limit = 1000 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] osapi_volume_ext_list = [] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] osapi_volume_listen_port = 8776 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] osapi_volume_use_ssl = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] osapi_volume_workers = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] per_volume_size_limit = -1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] periodic_fuzzy_delay = 60 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] periodic_interval = 60 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] public_endpoint = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] publish_errors = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] quota_backup_gigabytes = 1000 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] quota_backups = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] quota_gigabytes = 1000 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] quota_groups = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] quota_snapshots = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] quota_volumes = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] rate_limit_burst = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] rate_limit_except_level = CRITICAL {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] rate_limit_interval = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] reinit_driver_count = 3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] replication_device = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] report_discard_supported = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] report_interval = 120 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] reservation_clean_interval = 86400 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] reservation_expire = 86400 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] reserved_image_namespaces = [] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] reserved_percentage = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] rpc_response_timeout = 120 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] run_external_periodic_tasks = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] scst_target_driver = iscsi {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] scst_target_iqn_name = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] service_down_time = 720 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] shell_completion = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] snapshot_name_template = snapshot-%s {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] snapshot_same_host = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] split_loggers = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] state_path = /opt/stack/data/cinder {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] storage_availability_zone = nova {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] storage_protocol = iSCSI {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] syslog_log_facility = LOG_USER {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] target_helper = lioadm {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] target_ip_address = 192.168.122.72 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] target_port = 3260 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] target_protocol = iscsi {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] target_secondary_ip_addresses = [] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] trace_flags = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] transport_url = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] until_refresh = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] use_chap_auth = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] use_default_quota_class = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] use_journal = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] use_json = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] use_multipath_for_image_xfer = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] use_stderr = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] use_syslog = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] verify_glance_signatures = enabled {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_api_class = cinder.volume.api.API {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_backend_name = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_clear = zero {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_clear_ionice = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_clear_size = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_copy_bps_limit = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_dd_blocksize = 1M {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_name_template = volume-%s {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_service_inithost_offload = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volume_usage_audit_period = month {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] zoning_mode = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_concurrency.disable_process_locking = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.auth_section = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.auth_type = password {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.auth_version = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.cache = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.certfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.include_service_catalog = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.insecure = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.interface = public {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.keyfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_password = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcache_username = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.region_name = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.service_type = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.72/identity {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.backend = dogpile.cache.null {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.backend_argument = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.backend_expiration_time = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.config_prefix = cache.oslo {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.debug_cache_backend = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.enable_retry_client = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.enable_socket_keepalive = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.enabled = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.expiration_time = 600 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.hashclient_retry_attempts = 2 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.memcache_dead_retry = 300 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.memcache_pool_maxsize = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.memcache_sasl_enabled = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.password = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.proxies = [] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.redis_db = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.redis_server = localhost:6379 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.retry_attempts = 2 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.retry_delay = 0.0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.socket_keepalive_count = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.socket_keepalive_idle = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.socket_keepalive_interval = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.socket_timeout = 1.0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.tls_allowed_ciphers = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.tls_cafile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.tls_certfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.tls_enabled = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.tls_keyfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cache.username = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] coordination.backend_url = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.asyncio_connection = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.asyncio_slave_connection = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.backend = sqlalchemy {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.connection = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.connection_debug = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.connection_parameters = {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.connection_recycle_time = 3600 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.connection_trace = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.db_inc_retry_interval = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.db_max_retries = 20 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.db_max_retry_interval = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.db_retry_interval = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.max_overflow = 50 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.max_pool_size = 5 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.max_retries = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.mysql_wsrep_sync_wait = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.pool_timeout = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.retry_interval = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.slave_connection = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.sqlite_synchronous = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.synchronous_reader = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] database.use_db_reconnect = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_tracing.insecure = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler.connection_string = messaging:// {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler.enabled = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler.es_doc_type = notification {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler.es_scroll_size = 10000 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler.es_scroll_time = 2m {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler.filter_error_trace = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler.hmac_keys = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler.sentinel_service_name = mymaster {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler.socket_timeout = 0.1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler.trace_requests = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler.trace_sqlalchemy = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler_jaeger.process_tags = {} {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler_jaeger.service_name_prefix = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] profiler_otlp.service_name_prefix = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_policy.enforce_new_defaults = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_policy.policy_default_rule = default {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_policy.policy_file = policy.yaml {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] privsep_osbrick.group = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] privsep_osbrick.helper_command = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] privsep_osbrick.user = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cinder_sys_admin.group = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cinder_sys_admin.helper_command = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] cinder_sys_admin.user = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] service_user.auth_section = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] service_user.auth_type = password {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] service_user.cafile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] service_user.certfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] service_user.collect_timing = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] service_user.insecure = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] service_user.keyfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] service_user.send_service_user_token = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] service_user.split_loggers = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] service_user.timeout = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance.auth_section = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance.auth_type = password {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance.certfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance.collect_timing = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance.insecure = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance.keyfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance.region_name = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance.split_loggers = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] glance.timeout = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.backend_availability_zone = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.chap_password = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.chap_username = {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.disk_geometry = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.driver_client_cert = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.driver_client_cert_key = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.driver_data_namespace = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.driver_use_ssl = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.extra_capabilities = {} {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.filter_function = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.goodness_function = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.iscsi_target_flags = {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.iscsi_write_cache = on {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.iser_helper = tgtadm {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.iser_ip_address = 192.168.122.72 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.iser_port = 3260 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.lvm_share_target = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.lvm_type = auto {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.num_shell_tries = 3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.replication_device = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.report_discard_supported = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.reserved_percentage = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.target_helper = tgtadm {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.target_ip_address = 192.168.122.72 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.target_port = 3260 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.target_protocol = iscsi {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.trace_flags = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.unique_fqdn_network = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.use_chap_auth = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.volume_backend_name = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.volume_clear = zero {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.volume_clear_ionice = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.volume_clear_size = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack sudo[76599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack sudo[76599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_reports.file_event_handler = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_reports.log_dir = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.backend_host = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.chap_password = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.chap_username = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.disk_geometry = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.driver_client_cert = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.extra_capabilities = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.filter_function = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.goodness_function = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.iser_helper = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.iser_ip_address = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.iser_port = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.lvm_share_target = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.lvm_type = auto {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.num_shell_tries = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.replication_device = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.report_discard_supported = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.reserved_percentage = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.scst_target_driver = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.storage_protocol = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.target_helper = lioadm {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.target_ip_address = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.target_port = 3260 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.trace_flags = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.use_chap_auth = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.volume_clear = zero {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.volume_clear_size = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] lvmdriver-1.volumes_dir = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.ssl = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_notifications.driver = [] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_notifications.retry = -1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] key_manager.fixed_key = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.barbican_api_version = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.barbican_endpoint = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.barbican_endpoint_type = public {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.barbican_region_name = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.cafile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.certfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.collect_timing = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.insecure = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.keyfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.number_of_retries = 60 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.retry_delay = 1 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.send_service_user_token = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.split_loggers = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.timeout = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.verify_ssl = True {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican.verify_ssl_path = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican_service_user.auth_section = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican_service_user.auth_type = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican_service_user.cafile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican_service_user.certfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican_service_user.collect_timing = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican_service_user.insecure = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican_service_user.keyfile = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican_service_user.split_loggers = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] barbican_service_user.timeout = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.approle_role_id = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.approle_secret_id = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.auth_method = approle {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.auth_path = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.kv_mountpoint = secret {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.kv_path = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.kv_version = 2 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.namespace = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.root_token_id = **** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.ssl_ca_crt_file = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.timeout = 60.0 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.token_file = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.token_role = None {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.use_ssl = False {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 01:55:47 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] ******************************************************************************** {{(pid=76288) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 01:55:47 devstack sudo[76599]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:47 devstack sudo[76666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:47 devstack sudo[76666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:47 devstack sudo[76666]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.272s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 01:55:47 devstack cinder-volume[76550]: INFO cinder.brick.local_dev.lvm [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:47 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:48 devstack sudo[76758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:55:48 devstack sudo[76758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:48 devstack sudo[76758]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:48 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:48 devstack cinder-volume[76550]: DEBUG cinder.brick.local_dev.lvm [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76550) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 01 01:55:48 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:48 devstack sudo[76828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:48 devstack sudo[76828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:49 devstack sudo[76828]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:49 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.177s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:49 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:49 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:49 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:49 devstack sudo[77116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:49 devstack sudo[77116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:49 devstack sudo[77116]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:49 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:49 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:49 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:49 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:49 devstack sudo[77120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 01 01:55:49 devstack sudo[77120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:50 devstack sudo[77120]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:50 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.295s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:50 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:50 devstack sudo[77172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:55:50 devstack sudo[77172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:50 devstack sudo[77172]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:50 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:50 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:50 devstack sudo[77212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:55:50 devstack sudo[77212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:50 devstack sudo[77212]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:50 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:50 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:50 devstack sudo[77221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:50 devstack sudo[77221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:50 devstack sudo[77221]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:50 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:50 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:50 devstack sudo[77224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:50 devstack sudo[77224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:51 devstack sudo[77224]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:51 devstack sudo[77228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:51 devstack sudo[77228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:51 devstack sudo[77228]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:51 devstack cinder-volume[76550]: INFO cinder.volume.drivers.lvm [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:51 devstack sudo[77232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:51 devstack sudo[77232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:51 devstack sudo[77232]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG cinder.volume.drivers.lvm [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Updating volume stats {{(pid=76550) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:51 devstack sudo[77236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:55:51 devstack sudo[77236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:51 devstack sudo[77236]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:51 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:51 devstack sudo[77239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:51 devstack sudo[77239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:52 devstack sudo[77239]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:52 devstack sudo[77244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:52 devstack sudo[77244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:52 devstack sudo[77244]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:52 devstack sudo[77248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:52 devstack sudo[77248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:52 devstack sudo[77248]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:52 devstack cinder-volume[76550]: INFO cinder.volume.driver [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG cinder.volume.driver [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76550) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG oslo_db.sqlalchemy.engines [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76550) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG dbcounter [-] [76550] Writer thread running {{(pid=76550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG cinder.db.api [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Building query based on filter {{(pid=76550) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG cinder.image.image_utils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76550) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 01:55:52 devstack cinder-volume[76550]: INFO cinder.keymgr.migration [None req-ecd79376-d0a3-4fe6-a67a-0ebcf6ae1654 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG cinder.volume.drivers.lvm [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Updating volume stats {{(pid=76550) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:55:52 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:53 devstack sudo[77252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:55:53 devstack sudo[77252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:53 devstack sudo[77252]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:53 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:53 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:53 devstack sudo[77255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:53 devstack sudo[77255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:53 devstack sudo[77255]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:53 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.297s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:53 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:53 devstack sudo[77259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:53 devstack sudo[77259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:53 devstack sudo[77259]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:53 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:53 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:53 devstack sudo[77266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:53 devstack sudo[77266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:54 devstack sudo[77266]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:54 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:54 devstack cinder-volume[76550]: DEBUG cinder.manager [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Notifying Schedulers of capabilities ... {{(pid=76550) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:55:54 devstack cinder-volume[76550]: INFO cinder.volume.manager [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Driver initialization completed successfully. Sep 01 01:55:54 devstack cinder-volume[76550]: INFO cinder.manager [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Initiating service 2 cleanup Sep 01 01:55:54 devstack cinder-volume[76550]: INFO cinder.manager [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Service 2 cleanup completed. Sep 01 01:55:54 devstack cinder-volume[76550]: DEBUG cinder.service [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Creating RPC server for service cinder-volume {{(pid=76550) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 01:55:54 devstack cinder-volume[76550]: DEBUG cinder.service [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76550) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 01:55:54 devstack cinder-volume[76550]: INFO cinder.volume.manager [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 01 01:55:54 devstack cinder-volume[76550]: DEBUG cinder.volume.drivers.lvm [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Updating volume stats {{(pid=76550) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:55:54 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:54 devstack sudo[77270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:55:54 devstack sudo[77270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:54 devstack sudo[77270]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:54 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:54 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:54 devstack sudo[77273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:54 devstack sudo[77273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:54 devstack sudo[77273]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:54 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:54 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:54 devstack sudo[77276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:55:54 devstack sudo[77276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:55 devstack sudo[77276]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:55 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:55 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:55:55 devstack sudo[77279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:55:55 devstack sudo[77279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:55:55 devstack sudo[77279]: pam_unix(sudo:session): session closed for user root Sep 01 01:55:55 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:55:55 devstack cinder-volume[76550]: INFO cinder.volume.manager [None req-955bdd26-4ef4-45dd-b1e6-349091de1789 None None] Driver post RPC initialization completed successfully. Sep 01 01:55:57 devstack cinder-volume[76288]: DEBUG dbcounter [-] [76288] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76288) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:05 devstack cinder-volume[76550]: DEBUG dbcounter [-] [76550] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:05 devstack cinder-volume[76550]: DEBUG dbcounter [-] [76550] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:56:35 devstack cinder-volume[76550]: DEBUG oslo_service.periodic_task [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running periodic task VolumeManager._thread_info {{(pid=76550) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:56:35 devstack cinder-volume[76550]: DEBUG cinder.volume.manager [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] thread count: 6 {{(pid=76550) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:56:35 devstack cinder-volume[76550]: DEBUG cinder.volume.manager [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] thread info: [<_MainThread(MainThread, started 137206092456064)>, , , , , ] {{(pid=76550) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:57:35 devstack cinder-volume[76550]: DEBUG oslo_service.periodic_task [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76550) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:57:35 devstack cinder-volume[76550]: DEBUG cinder.volume.drivers.lvm [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Updating volume stats {{(pid=76550) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:57:35 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:35 devstack sudo[82503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:57:35 devstack sudo[82503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:35 devstack sudo[82503]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:35 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:35 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:35 devstack sudo[82506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:57:35 devstack sudo[82506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:36 devstack sudo[82506]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:36 devstack sudo[82509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:57:36 devstack sudo[82509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:36 devstack sudo[82509]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:57:36 devstack sudo[82512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:57:36 devstack sudo[82512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:57:36 devstack sudo[82512]: pam_unix(sudo:session): session closed for user root Sep 01 01:57:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:57:36 devstack cinder-volume[76550]: DEBUG cinder.manager [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Notifying Schedulers of capabilities ... {{(pid=76550) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:57:36 devstack cinder-volume[76550]: DEBUG oslo_service.periodic_task [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running periodic task VolumeManager._thread_info {{(pid=76550) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:57:36 devstack cinder-volume[76550]: DEBUG cinder.volume.manager [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] thread count: 6 {{(pid=76550) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:57:36 devstack cinder-volume[76550]: DEBUG cinder.volume.manager [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] thread info: [<_MainThread(MainThread, started 137206092456064)>, , , , , ] {{(pid=76550) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:58:05 devstack cinder-volume[76550]: DEBUG dbcounter [-] [76550] Writing DB stats cinder:SELECT=1 {{(pid=76550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:05 devstack cinder-volume[76550]: DEBUG dbcounter [-] [76550] Writing DB stats cinder:UPDATE=1 {{(pid=76550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 01:58:35 devstack cinder-volume[76550]: DEBUG oslo_service.periodic_task [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76550) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:58:35 devstack cinder-volume[76550]: DEBUG cinder.volume.drivers.lvm [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Updating volume stats {{(pid=76550) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:58:35 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:35 devstack sudo[83992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:58:35 devstack sudo[83992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:35 devstack sudo[83992]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:35 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:35 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:35 devstack sudo[84000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:58:35 devstack sudo[84000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:36 devstack sudo[84000]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.348s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:36 devstack sudo[84005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:58:36 devstack sudo[84005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:36 devstack sudo[84005]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:58:36 devstack sudo[84008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:58:36 devstack sudo[84008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:58:36 devstack sudo[84008]: pam_unix(sudo:session): session closed for user root Sep 01 01:58:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:58:36 devstack cinder-volume[76550]: DEBUG cinder.manager [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Notifying Schedulers of capabilities ... {{(pid=76550) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:58:36 devstack cinder-volume[76550]: DEBUG oslo_service.periodic_task [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running periodic task VolumeManager._thread_info {{(pid=76550) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:58:36 devstack cinder-volume[76550]: DEBUG cinder.volume.manager [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] thread count: 6 {{(pid=76550) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:58:36 devstack cinder-volume[76550]: DEBUG cinder.volume.manager [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] thread info: [<_MainThread(MainThread, started 137206092456064)>, , , , , ] {{(pid=76550) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 01:59:35 devstack cinder-volume[76550]: DEBUG oslo_service.periodic_task [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76550) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:59:35 devstack cinder-volume[76550]: DEBUG cinder.volume.drivers.lvm [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Updating volume stats {{(pid=76550) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 01 01:59:35 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:35 devstack sudo[85471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 01 01:59:35 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:35 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:35 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:35 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:35 devstack sudo[85474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:59:35 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:36 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:36 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 01 01:59:36 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:36 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 01:59:36 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 01 01:59:36 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 01:59:36 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Sep 01 01:59:36 devstack cinder-volume[76550]: DEBUG oslo_concurrency.processutils [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76550) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 01:59:36 devstack cinder-volume[76550]: DEBUG cinder.manager [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Notifying Schedulers of capabilities ... {{(pid=76550) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 01:59:36 devstack cinder-volume[76550]: DEBUG oslo_service.periodic_task [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] Running periodic task VolumeManager._thread_info {{(pid=76550) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 01:59:36 devstack cinder-volume[76550]: DEBUG cinder.volume.manager [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] thread count: 6 {{(pid=76550) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 01:59:36 devstack cinder-volume[76550]: DEBUG cinder.volume.manager [None req-c1fcd4ef-05c4-43f2-9b9c-41e826bcc5ed None None] thread info: [<_MainThread(MainThread, started 137206092456064)>, , , , , ] {{(pid=76550) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:00:05 devstack cinder-volume[76550]: DEBUG dbcounter [-] [76550] Writing DB stats cinder:SELECT=1 {{(pid=76550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:05 devstack cinder-volume[76550]: DEBUG dbcounter [-] [76550] Writing DB stats cinder:UPDATE=1 {{(pid=76550) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:22 devstack cinder-volume[76288]: INFO oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Caught SIGTERM, stopping children Sep 01 02:00:22 devstack cinder-volume[76288]: DEBUG oslo_concurrency.lockutils [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Acquiring lock "singleton_lock" {{(pid=76288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 02:00:22 devstack cinder-volume[76288]: DEBUG oslo_concurrency.lockutils [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Acquired lock "singleton_lock" {{(pid=76288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 02:00:22 devstack cinder-volume[76288]: DEBUG oslo_concurrency.lockutils [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Releasing lock "singleton_lock" {{(pid=76288) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 02:00:22 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Stop services. {{(pid=76288) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 02:00:22 devstack cinder-volume[76288]: DEBUG oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Killing children. {{(pid=76288) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 02:00:22 devstack cinder-volume[76288]: INFO oslo_service.backend._eventlet.service [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Waiting on 1 children to exit Sep 01 02:00:27 devstack cinder-volume[76550]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 01 02:00:27 devstack cinder-volume[86446]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 02:00:27 devstack cinder-volume[86446]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 02:00:27 devstack cinder-volume[86446]: we strongly recommend against using it for new projects. Sep 01 02:00:27 devstack cinder-volume[86446]: If you are already using Eventlet, we recommend migrating to a different Sep 01 02:00:27 devstack cinder-volume[86446]: framework. For more detail see Sep 01 02:00:27 devstack cinder-volume[86446]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 02:00:27 devstack cinder-volume[86446]: import eventlet # noqa Sep 01 02:00:29 devstack cinder-volume[76550]: DEBUG oslo_concurrency.lockutils [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Acquiring lock "singleton_lock" {{(pid=76550) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 02:00:29 devstack cinder-volume[76550]: DEBUG oslo_concurrency.lockutils [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Acquired lock "singleton_lock" {{(pid=76550) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 02:00:29 devstack cinder-volume[76550]: DEBUG oslo_concurrency.lockutils [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Releasing lock "singleton_lock" {{(pid=76550) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 02:00:29 devstack cinder-volume[76550]: WARNING amqp [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 02:00:29 devstack cinder-volume[76550]: WARNING amqp [None req-558df7b5-4280-479d-b4a8-723ff2b19901 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 02:00:30 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 02:00:30 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 02:00:30 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 02:00:30 devstack cinder-volume[86446]: INFO dbcounter [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Registered counter for database cinder Sep 01 02:00:30 devstack cinder-volume[86446]: DEBUG oslo_db.sqlalchemy.engines [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86446) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG dbcounter [-] [86446] Writer thread running {{(pid=86446) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 02:00:31 devstack cinder-volume[86446]: INFO cinder.rpc [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 02:00:31 devstack cinder-volume[86446]: INFO cinder.rpc [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_db.sqlalchemy.engines [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86446) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 02:00:31 devstack cinder-volume[86446]: INFO cinder.volume.manager [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Determined volume DB was empty at startup. Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG cinder.volume.manager [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86446) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 02:00:31 devstack cinder-volume[86446]: INFO cinder.volume.manager [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 01 02:00:31 devstack cinder-volume[86446]: WARNING stevedore.named [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 02:00:31 devstack cinder-volume[86446]: WARNING castellan.key_manager [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 02:00:31 devstack cinder-volume[86446]: WARNING cinder.keymgr.conf_key_mgr [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 02:00:31 devstack cinder-volume[86446]: INFO cinder.volume.manager [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_db.sqlalchemy.engines [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86446) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 02:00:31 devstack cinder-volume[86446]: INFO oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Starting 1 workers Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Started child 86665 {{(pid=86446) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Full set of CONF: {{(pid=86446) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] ******************************************************************************** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Configuration options gathered from: {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] ================================================================================ {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] allow_availability_zone_fallback = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] allow_compression_on_image_upload = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] allowed_direct_url_schemes = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] api_rate_limit = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] auth_strategy = keystone {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_availability_zone = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_host = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_stats_polling_interval = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backup_api_class = cinder.backup.api.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backup_name_template = backup-%s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backup_use_same_host = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backup_use_temp_snapshot = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] chap_password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] chap_username = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cinder_internal_tenant_project_id = 39a560deb77f473495d0b68721c8e1f8 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cinder_internal_tenant_user_id = a0432939d80847d4af57d915f4e3ab39 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cluster = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86665]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] compression_format = gzip {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] compute_api_class = cinder.compute.nova.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] config_dir = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] config_source = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] control_exchange = openstack {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] debug = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] default_availability_zone = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] default_group_type = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] default_volume_type = QuobyteHD {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] disk_geometry = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] driver_client_cert = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] driver_client_cert_key = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] driver_data_namespace = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] driver_ssl_cert_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] driver_ssl_cert_verify = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] driver_use_ssl = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] enable_new_services = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] enable_unsupported_driver = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] enabled_backends = ['QuobyteHD'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] enforce_multipath_for_image_xfer = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] filter_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance_api_insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance_api_servers = ['http://192.168.122.72/image'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance_api_ssl_compression = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance_ca_certificates_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance_catalog_info = image:glance:publicURL {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance_certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance_keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance_num_retries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance_request_timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] goodness_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] graceful_shutdown_timeout = 5 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] group_api_class = cinder.group.api.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] host = devstack {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] image_compress_on_upload = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] image_conversion_address_space_limit = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] image_conversion_cpu_limit = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] image_conversion_disable = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] image_upload_use_cinder_backend = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] image_upload_use_internal_tenant = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] image_volume_cache_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] image_volume_cache_max_count = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] image_volume_cache_max_size_gb = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] init_host_max_objects_retrieval = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] instance_format = [instance: %(uuid)s] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] iscsi_target_flags = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] iscsi_write_cache = on {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] iser_helper = tgtadm {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] iser_ip_address = 192.168.122.72 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] iser_port = 3260 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] log_color = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] log_config_append = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] log_dir = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] log_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] log_options = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] log_rotate_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] log_rotate_interval_type = days {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] log_rotation_type = none {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] max_age = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] max_logfile_count = 30 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] max_logfile_size_mb = 200 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] max_over_subscription_ratio = 20.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] message_reap_interval = 86400 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] message_ttl = 2592000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] migration_create_volume_timeout_secs = 300 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] monkey_patch = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] monkey_patch_modules = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] my_ip = 192.168.122.72 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] no_snapshot_gb_quota = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] num_iser_scan_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] num_shell_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 02:00:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.remotefs [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86665) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] num_volume_device_scan_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] nvmeof_conn_info_version = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] nvmet_ns_id = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] nvmet_port_id = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] osapi_max_limit = 1000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] osapi_volume_ext_list = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] osapi_volume_listen = 0.0.0.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] osapi_volume_listen_port = 8776 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] osapi_volume_use_ssl = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] osapi_volume_workers = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] per_volume_size_limit = -1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] periodic_fuzzy_delay = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] periodic_interval = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] project_id_regex = [0-9a-f\-]+ {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] public_endpoint = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] publish_errors = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] quota_backup_gigabytes = 1000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] quota_backups = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] quota_gigabytes = 1000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] quota_groups = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] quota_snapshots = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] quota_volumes = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] rate_limit_burst = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] rate_limit_except_level = CRITICAL {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] rate_limit_interval = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] reinit_driver_count = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] replication_device = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] report_discard_supported = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] report_interval = 120 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] reservation_clean_interval = 86400 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] reservation_expire = 86400 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] reserved_image_namespaces = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] reserved_percentage = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] rpc_response_timeout = 120 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] run_external_periodic_tasks = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] scst_target_driver = iscsi {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] scst_target_iqn_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] service_down_time = 720 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] shell_completion = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] snapshot_name_template = snapshot-%s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] split_loggers = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] state_path = /opt/stack/data/cinder {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] storage_availability_zone = nova {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] storage_protocol = iSCSI {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] syslog_log_facility = LOG_USER {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] target_helper = lioadm {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] target_ip_address = 192.168.122.72 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] target_port = 3260 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] target_protocol = iscsi {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] target_secondary_ip_addresses = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] trace_flags = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] transfer_api_class = cinder.transfer.api.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] transport_url = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] until_refresh = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] use_chap_auth = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] use_default_quota_class = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] use_journal = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] use_json = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] use_multipath_for_image_xfer = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] use_stderr = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] use_syslog = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] verify_glance_signatures = enabled {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_api_class = cinder.volume.api.API {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_backend_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_clear = zero {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_clear_ionice = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_clear_size = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_copy_bps_limit = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_dd_blocksize = 1M {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_name_template = volume-%s {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_service_inithost_offload = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volume_usage_audit_period = month {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] zoning_mode = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_concurrency.disable_process_locking = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.auth_section = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.auth_type = password {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.auth_version = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.cache = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.delay_auth_decision = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.http_connect_timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.include_service_catalog = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.interface = public {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcache_username = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.region_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.service_token_roles_required = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.service_type = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.token_cache_time = 300 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.72/identity {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.backend = dogpile.cache.null {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.backend_argument = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.backend_expiration_time = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.config_prefix = cache.oslo {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.debug_cache_backend = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.enable_retry_client = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.enable_socket_keepalive = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.expiration_time = 600 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.hashclient_retry_attempts = 2 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.memcache_dead_retry = 300 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.memcache_pool_maxsize = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.memcache_sasl_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.proxies = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.redis_db = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.redis_sentinel_service_name = mymaster {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.redis_server = localhost:6379 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.retry_attempts = 2 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.retry_delay = 0.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.socket_keepalive_count = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.socket_keepalive_idle = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.socket_keepalive_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.socket_timeout = 1.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.tls_allowed_ciphers = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.tls_cafile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.tls_certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.tls_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.tls_keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cache.username = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] coordination.backend_url = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.asyncio_connection = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.asyncio_slave_connection = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.backend = sqlalchemy {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.connection = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.connection_debug = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.connection_parameters = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.connection_recycle_time = 3600 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.connection_trace = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.db_inc_retry_interval = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.db_max_retries = 20 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.db_max_retry_interval = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.db_retry_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.max_overflow = 50 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.max_pool_size = 5 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.max_retries = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.mysql_wsrep_sync_wait = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.pool_timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.retry_interval = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.slave_connection = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.sqlite_synchronous = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.synchronous_reader = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] database.use_db_reconnect = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_tracing.insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler.connection_string = messaging:// {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler.enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler.es_doc_type = notification {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler.es_scroll_size = 10000 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler.es_scroll_time = 2m {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler.filter_error_trace = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler.hmac_keys = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler.sentinel_service_name = mymaster {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler.socket_timeout = 0.1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler.trace_requests = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler.trace_sqlalchemy = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler_jaeger.process_tags = {} {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler_jaeger.service_name_prefix = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] profiler_otlp.service_name_prefix = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_policy.enforce_new_defaults = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_policy.policy_default_rule = default {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_policy.policy_file = policy.yaml {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_policy.remote_timeout = 60.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] privsep_osbrick.group = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] privsep_osbrick.helper_command = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] privsep_osbrick.user = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cinder_sys_admin.group = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cinder_sys_admin.helper_command = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] cinder_sys_admin.user = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] service_user.auth_section = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] service_user.auth_type = password {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] service_user.cafile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] service_user.certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] service_user.collect_timing = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] service_user.insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] service_user.keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] service_user.send_service_user_token = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] service_user.split_loggers = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] service_user.timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance.auth_section = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance.auth_type = password {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance.certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance.collect_timing = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance.insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance.keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance.region_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance.split_loggers = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] glance.timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.backend_availability_zone = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.chap_password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.chap_username = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.disk_geometry = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.driver_client_cert = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.driver_client_cert_key = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.driver_data_namespace = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.driver_use_ssl = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.enable_unsupported_driver = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.extra_capabilities = {} {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.filter_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.goodness_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.iscsi_target_flags = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.iscsi_write_cache = on {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.iser_helper = tgtadm {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.iser_ip_address = 192.168.122.72 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.iser_port = 3260 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nas_host = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nas_login = admin {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nas_mount_options = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nas_password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nas_private_key = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nas_share_path = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nas_ssh_port = 22 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.num_shell_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.nvmet_port_id = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.quobyte_client_cfg = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86665) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 02:00:31 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.quobyte [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 02:00:31 devstack cinder-volume[86665]: WARNING cinder.volume.drivers.quobyte [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.quobyte_volume_url = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.replication_device = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Running cmd (subprocess): mount.quobyte {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.report_discard_supported = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.reserved_percentage = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.scst_target_driver = iscsi {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.scst_target_iqn_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.storage_protocol = iSCSI {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.target_helper = tgtadm {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.target_ip_address = 192.168.122.72 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.target_port = 3260 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.target_protocol = iscsi {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.trace_flags = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.unique_fqdn_network = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.use_chap_auth = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.volume_backend_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.volume_clear = zero {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.volume_clear_ionice = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.volume_clear_size = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_reports.file_event_handler = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_reports.log_dir = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.backend_availability_zone = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.backend_host = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.chap_password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.chap_username = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.chiscsi_conf = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.disk_geometry = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.driver_client_cert = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.driver_client_cert_key = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.driver_data_namespace = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.driver_use_ssl = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.extra_capabilities = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.filter_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.goodness_function = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.iscsi_target_flags = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.iscsi_write_cache = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.iser_helper = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.iser_ip_address = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.iser_port = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.iser_target_prefix = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nas_host = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nas_login = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nas_mount_options = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nas_password = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nas_private_key = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nas_share_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nas_ssh_port = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.num_shell_tries = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nvmet_ns_id = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.nvmet_port_id = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.replication_device = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.report_discard_supported = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.reserved_percentage = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.scst_target_driver = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.storage_protocol = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.target_helper = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.target_ip_address = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.target_port = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.target_prefix = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.target_protocol = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.trace_flags = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.unique_fqdn_network = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.use_chap_auth = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.volume_clear = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.volume_clear_ionice = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.volume_clear_size = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] QuobyteHD.volumes_dir = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.ssl = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.ssl_version = {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_notifications.driver = [] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_notifications.retry = -1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] oslo_messaging_notifications.transport_url = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] key_manager.fixed_key = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.barbican_api_version = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.barbican_endpoint = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.barbican_endpoint_type = public {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.barbican_region_name = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.cafile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.collect_timing = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.number_of_retries = 60 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.retry_delay = 1 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.send_service_user_token = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.split_loggers = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.verify_ssl = True {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican.verify_ssl_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican_service_user.auth_section = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican_service_user.auth_type = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican_service_user.cafile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican_service_user.certfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican_service_user.collect_timing = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican_service_user.insecure = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican_service_user.keyfile = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican_service_user.split_loggers = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] barbican_service_user.timeout = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.approle_role_id = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.approle_secret_id = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.auth_method = approle {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.auth_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.kv_mountpoint = secret {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.kv_path = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.kv_version = 2 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.namespace = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.root_token_id = **** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.ssl_ca_crt_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.timeout = 60.0 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.token_file = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.token_role = None {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.use_ssl = False {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:31 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] ******************************************************************************** {{(pid=86446) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 02:00:31 devstack quobyte-client[86670]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 02:00:31 devstack quobyte-client[86670]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 02:00:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] CMD "mount.quobyte" returned: 1 in 0.113s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:31 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:31 devstack cinder-volume[86665]: INFO cinder.volume.drivers.quobyte [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be ... Sep 01 02:00:31 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 -c /etc/quobyte/client-cinder.cfg {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:31 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 -c /etc/quobyte/client-cinder.cfg Sep 01 02:00:31 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:32 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.497s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:32 devstack cinder-volume[86665]: INFO cinder.volume.drivers.quobyte [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be succeeded Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.511s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:32 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:00:32 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:32 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.287s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:32 devstack cinder-volume[86665]: INFO cinder.volume.driver [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG cinder.volume.driver [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.065715789795, 'free_capacity_gb': 1774.065715789795, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86665) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG oslo_db.sqlalchemy.engines [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86665) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG dbcounter [-] [86665] Writer thread running {{(pid=86665) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG cinder.db.api [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Building query based on filter {{(pid=86665) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG cinder.image.image_utils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86665) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 02:00:32 devstack cinder-volume[86665]: INFO cinder.keymgr.migration [None req-8d506e19-5d7f-4445-8646-cb4ccac9c155 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:32 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:32 devstack sudo[86744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:00:32 devstack sudo[86744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:33 devstack sudo[86744]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.259s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:33 devstack cinder-volume[86665]: DEBUG cinder.manager [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Notifying Schedulers of capabilities ... {{(pid=86665) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Driver initialization completed successfully. Sep 01 02:00:33 devstack cinder-volume[86665]: INFO cinder.manager [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Initiating service 3 cleanup Sep 01 02:00:33 devstack cinder-volume[86665]: INFO cinder.manager [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Service 3 cleanup completed. Sep 01 02:00:33 devstack cinder-volume[86665]: DEBUG cinder.service [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Creating RPC server for service cinder-volume {{(pid=86665) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 02:00:33 devstack cinder-volume[86665]: DEBUG cinder.service [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86665) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 02:00:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 02:00:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=86665) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:33 devstack cinder-volume[86665]: DEBUG cinder.volume.drivers.quobyte [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=86665) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86665) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:33 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:00:33 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:33 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:33 devstack cinder-volume[86665]: DEBUG oslo_concurrency.processutils [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.298s {{(pid=86665) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:33 devstack cinder-volume[86665]: INFO cinder.volume.manager [None req-ad4d4d73-145e-4d5a-8ca3-719e2d8febf7 None None] Driver post RPC initialization completed successfully. Sep 01 02:00:37 devstack cinder-volume[86446]: INFO oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Caught SIGTERM, stopping children Sep 01 02:00:37 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Acquiring lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 02:00:37 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Acquired lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 02:00:37 devstack cinder-volume[86446]: DEBUG oslo_concurrency.lockutils [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Releasing lock "singleton_lock" {{(pid=86446) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 02:00:37 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Stop services. {{(pid=86446) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 01 02:00:37 devstack cinder-volume[86446]: DEBUG oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Killing children. {{(pid=86446) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 01 02:00:37 devstack cinder-volume[86446]: INFO oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Waiting on 1 children to exit Sep 01 02:00:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Acquiring lock "singleton_lock" {{(pid=86665) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 02:00:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Acquired lock "singleton_lock" {{(pid=86665) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 02:00:41 devstack cinder-volume[86665]: DEBUG oslo_concurrency.lockutils [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Releasing lock "singleton_lock" {{(pid=86665) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 02:00:41 devstack cinder-volume[86665]: WARNING amqp [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 02:00:41 devstack cinder-volume[86665]: WARNING amqp [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 01 02:00:41 devstack cinder-volume[86446]: INFO oslo_service.backend._eventlet.service [None req-6cfc914f-962d-4c32-a28e-4cfcf3862dcb None None] Child 86665 exited with status 0 Sep 01 02:00:42 devstack cinder-volume[87060]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 01 02:00:42 devstack cinder-volume[87060]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 02:00:42 devstack cinder-volume[87060]: we strongly recommend against using it for new projects. Sep 01 02:00:42 devstack cinder-volume[87060]: If you are already using Eventlet, we recommend migrating to a different Sep 01 02:00:42 devstack cinder-volume[87060]: framework. For more detail see Sep 01 02:00:42 devstack cinder-volume[87060]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 02:00:42 devstack cinder-volume[87060]: import eventlet # noqa Sep 01 02:00:45 devstack cinder-volume[87060]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 01 02:00:45 devstack cinder-volume[87060]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 01 02:00:45 devstack cinder-volume[87060]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87060) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 01 02:00:46 devstack cinder-volume[87060]: INFO dbcounter [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Registered counter for database cinder Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_db.sqlalchemy.engines [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG dbcounter [-] [87060] Writer thread running {{(pid=87060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 02:00:46 devstack cinder-volume[87060]: INFO cinder.rpc [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 01 02:00:46 devstack cinder-volume[87060]: INFO cinder.rpc [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_db.sqlalchemy.engines [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 02:00:46 devstack cinder-volume[87060]: INFO cinder.volume.manager [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Determined volume DB was empty at startup. Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG cinder.volume.manager [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87060) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 01 02:00:46 devstack cinder-volume[87060]: WARNING stevedore.named [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 01 02:00:46 devstack cinder-volume[87060]: WARNING castellan.key_manager [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 02:00:46 devstack cinder-volume[87060]: WARNING cinder.keymgr.conf_key_mgr [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 01 02:00:46 devstack cinder-volume[87060]: INFO cinder.volume.manager [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_db.sqlalchemy.engines [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87060) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 02:00:46 devstack cinder-volume[87060]: INFO oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Starting 1 workers Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Started child 87389 {{(pid=87060) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Full set of CONF: {{(pid=87060) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] ******************************************************************************** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] Configuration options gathered from: {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] ================================================================================ {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] allow_availability_zone_fallback = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] allow_compression_on_image_upload = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] allowed_direct_url_schemes = [] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] api_rate_limit = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] auth_strategy = keystone {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_availability_zone = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_host = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_name = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_stats_polling_interval = 60 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backup_api_class = cinder.backup.api.API {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87389]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backup_name_template = backup-%s {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backup_use_same_host = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backup_use_temp_snapshot = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] chap_password = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] chap_username = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cinder_internal_tenant_project_id = 39a560deb77f473495d0b68721c8e1f8 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cinder_internal_tenant_user_id = a0432939d80847d4af57d915f4e3ab39 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cluster = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] compression_format = gzip {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] compute_api_class = cinder.compute.nova.API {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] config_dir = [] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] config_source = [] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] control_exchange = openstack {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] debug = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] default_availability_zone = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] default_group_type = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] default_volume_type = QuobyteHD {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] disk_geometry = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] driver_client_cert = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] driver_client_cert_key = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] driver_data_namespace = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] driver_ssl_cert_path = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] driver_ssl_cert_verify = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] driver_use_ssl = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] enable_new_services = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] enable_unsupported_driver = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] enabled_backends = ['QuobyteHD'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] enforce_multipath_for_image_xfer = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] filter_function = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance_api_insecure = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance_api_servers = ['http://192.168.122.72/image'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance_api_ssl_compression = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance_ca_certificates_file = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance_catalog_info = image:glance:publicURL {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance_certfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance_keyfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance_num_retries = 3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance_request_timeout = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] goodness_function = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] graceful_shutdown_timeout = 5 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] group_api_class = cinder.group.api.API {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] host = devstack {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] image_compress_on_upload = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] image_conversion_address_space_limit = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] image_conversion_cpu_limit = 60 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] image_conversion_disable = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] image_upload_use_cinder_backend = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] image_upload_use_internal_tenant = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] image_volume_cache_enabled = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] image_volume_cache_max_count = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] image_volume_cache_max_size_gb = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] init_host_max_objects_retrieval = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] instance_format = [instance: %(uuid)s] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] iscsi_target_flags = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] iscsi_write_cache = on {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] iser_helper = tgtadm {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] iser_ip_address = 192.168.122.72 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] iser_port = 3260 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] log_color = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] log_config_append = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] log_dir = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] log_file = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] log_options = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] log_rotate_interval = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] log_rotate_interval_type = days {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] log_rotation_type = none {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] max_age = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] max_logfile_count = 30 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] max_logfile_size_mb = 200 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] max_over_subscription_ratio = 20.0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] message_reap_interval = 86400 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] message_ttl = 2592000 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] migration_create_volume_timeout_secs = 300 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] monkey_patch = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] monkey_patch_modules = [] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] my_ip = 192.168.122.72 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] no_snapshot_gb_quota = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] num_iser_scan_tries = 3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] num_shell_tries = 3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] num_volume_device_scan_tries = 3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] nvmeof_conn_info_version = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] nvmet_ns_id = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] nvmet_port_id = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] osapi_max_limit = 1000 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] osapi_volume_ext_list = [] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] osapi_volume_listen = 0.0.0.0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] osapi_volume_listen_port = 8776 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] osapi_volume_use_ssl = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] osapi_volume_workers = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] per_volume_size_limit = -1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] periodic_fuzzy_delay = 60 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] periodic_interval = 60 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] project_id_regex = [0-9a-f\-]+ {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] public_endpoint = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] publish_errors = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] quota_backup_gigabytes = 1000 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87389) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] quota_backups = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] quota_gigabytes = 1000 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] quota_groups = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] quota_snapshots = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] quota_volumes = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] rate_limit_burst = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] rate_limit_except_level = CRITICAL {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] rate_limit_interval = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] reinit_driver_count = 3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] replication_device = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] report_discard_supported = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] report_interval = 120 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] reservation_clean_interval = 86400 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] reservation_expire = 86400 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] reserved_image_namespaces = [] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] reserved_percentage = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] rpc_response_timeout = 120 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] run_external_periodic_tasks = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] scst_target_driver = iscsi {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] scst_target_iqn_name = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] service_down_time = 720 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] shell_completion = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] snapshot_name_template = snapshot-%s {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] split_loggers = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] state_path = /opt/stack/data/cinder {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] storage_availability_zone = nova {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] storage_protocol = iSCSI {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] syslog_log_facility = LOG_USER {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] target_helper = lioadm {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] target_ip_address = 192.168.122.72 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] target_port = 3260 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] target_protocol = iscsi {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] target_secondary_ip_addresses = [] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] trace_flags = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] transfer_api_class = cinder.transfer.api.API {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] transport_url = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] until_refresh = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] use_chap_auth = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] use_default_quota_class = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] use_journal = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] use_json = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] use_multipath_for_image_xfer = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] use_stderr = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] use_syslog = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] verify_glance_signatures = enabled {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_api_class = cinder.volume.api.API {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_backend_name = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_clear = zero {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_clear_ionice = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_clear_size = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_copy_bps_limit = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:46 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_dd_blocksize = 1M {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_name_template = volume-%s {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_service_inithost_offload = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volume_usage_audit_period = month {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] zoning_mode = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_concurrency.disable_process_locking = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.auth_section = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.auth_type = password {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.auth_version = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.cache = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.certfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.delay_auth_decision = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.http_connect_timeout = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.include_service_catalog = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.insecure = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.interface = public {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.keyfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_password = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcache_username = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.region_name = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.service_token_roles_required = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.service_type = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.token_cache_time = 300 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.72/identity {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.backend = dogpile.cache.null {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.backend_argument = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.backend_expiration_time = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.config_prefix = cache.oslo {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.debug_cache_backend = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.enable_retry_client = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.enable_socket_keepalive = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.enabled = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.expiration_time = 600 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.hashclient_retry_attempts = 2 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.memcache_dead_retry = 300 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.memcache_pool_maxsize = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.memcache_sasl_enabled = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.password = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.proxies = [] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.redis_db = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.redis_sentinel_service_name = mymaster {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.redis_server = localhost:6379 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.retry_attempts = 2 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.retry_delay = 0.0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.socket_keepalive_count = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.socket_keepalive_idle = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.socket_keepalive_interval = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.socket_timeout = 1.0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.tls_allowed_ciphers = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.tls_cafile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.tls_certfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.tls_enabled = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.tls_keyfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cache.username = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] coordination.backend_url = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.asyncio_connection = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.asyncio_slave_connection = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.backend = sqlalchemy {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.connection = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.connection_debug = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.connection_parameters = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.connection_recycle_time = 3600 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.connection_trace = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.db_inc_retry_interval = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.db_max_retries = 20 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.db_max_retry_interval = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.db_retry_interval = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.max_overflow = 50 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.max_pool_size = 5 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.max_retries = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.mysql_wsrep_sync_wait = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.pool_timeout = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.retry_interval = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.slave_connection = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.sqlite_synchronous = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.synchronous_reader = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] database.use_db_reconnect = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_tracing.insecure = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler.connection_string = messaging:// {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler.enabled = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler.es_doc_type = notification {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler.es_scroll_size = 10000 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler.es_scroll_time = 2m {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler.filter_error_trace = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler.hmac_keys = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler.sentinel_service_name = mymaster {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler.socket_timeout = 0.1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler.trace_requests = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler.trace_sqlalchemy = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler_jaeger.process_tags = {} {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler_jaeger.service_name_prefix = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] profiler_otlp.service_name_prefix = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_policy.enforce_new_defaults = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_policy.policy_default_rule = default {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_policy.policy_file = policy.yaml {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_policy.remote_timeout = 60.0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] privsep_osbrick.group = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] privsep_osbrick.helper_command = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] privsep_osbrick.user = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cinder_sys_admin.group = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cinder_sys_admin.helper_command = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] cinder_sys_admin.user = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] service_user.auth_section = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] service_user.auth_type = password {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] service_user.cafile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] service_user.certfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] service_user.collect_timing = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] service_user.insecure = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] service_user.keyfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] service_user.send_service_user_token = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] service_user.split_loggers = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] service_user.timeout = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance.auth_section = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance.auth_type = password {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance.certfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance.collect_timing = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance.insecure = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance.keyfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance.region_name = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance.split_loggers = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] glance.timeout = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.backend_availability_zone = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.chap_password = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.chap_username = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.disk_geometry = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.driver_client_cert = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.driver_client_cert_key = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.driver_data_namespace = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.driver_use_ssl = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.enable_unsupported_driver = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.extra_capabilities = {} {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.filter_function = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.goodness_function = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.iscsi_target_flags = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.iscsi_write_cache = on {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.iser_helper = tgtadm {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.iser_ip_address = 192.168.122.72 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.iser_port = 3260 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nas_host = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nas_login = admin {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nas_mount_options = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nas_password = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nas_private_key = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nas_share_path = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nas_ssh_port = 22 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.num_shell_tries = 3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.nvmet_port_id = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.quobyte_client_cfg = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.quobyte_volume_url = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.replication_device = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.report_discard_supported = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.reserved_percentage = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.scst_target_driver = iscsi {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.scst_target_iqn_name = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.storage_protocol = iSCSI {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.target_helper = tgtadm {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.target_ip_address = 192.168.122.72 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.target_port = 3260 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.target_protocol = iscsi {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.trace_flags = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.unique_fqdn_network = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.use_chap_auth = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.volume_backend_name = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.volume_clear = zero {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.volume_clear_ionice = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.volume_clear_size = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_reports.file_event_handler = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_reports.log_dir = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.backend_availability_zone = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.backend_host = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.chap_password = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.chap_username = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.chiscsi_conf = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.disk_geometry = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.driver_client_cert = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.driver_client_cert_key = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.driver_data_namespace = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.driver_use_ssl = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.extra_capabilities = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.filter_function = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.goodness_function = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.iscsi_target_flags = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87389) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.iscsi_write_cache = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.quobyte [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.iser_helper = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.iser_ip_address = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.iser_port = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.iser_target_prefix = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.quobyte [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Running cmd (subprocess): mount.quobyte {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nas_host = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nas_login = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nas_mount_options = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nas_password = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nas_private_key = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nas_share_path = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nas_ssh_port = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.num_shell_tries = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nvmet_ns_id = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.nvmet_port_id = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.replication_device = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.report_discard_supported = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.reserved_percentage = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.scst_target_driver = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.storage_protocol = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.target_helper = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.target_ip_address = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.target_port = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.target_prefix = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.target_protocol = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.trace_flags = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.unique_fqdn_network = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.use_chap_auth = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.volume_clear = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.volume_clear_ionice = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.volume_clear_size = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] QuobyteHD.volumes_dir = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.ssl = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.ssl_version = {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_notifications.driver = [] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_notifications.retry = -1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] oslo_messaging_notifications.transport_url = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] key_manager.fixed_key = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.barbican_api_version = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.barbican_endpoint = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.barbican_endpoint_type = public {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.barbican_region_name = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.cafile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.certfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.collect_timing = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack quobyte-client[87390]: Reading configuration file: /etc/quobyte/client.cfg Sep 01 02:00:47 devstack quobyte-client[87390]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.insecure = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.keyfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.number_of_retries = 60 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.retry_delay = 1 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.send_service_user_token = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.split_loggers = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.timeout = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.verify_ssl = True {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican.verify_ssl_path = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican_service_user.auth_section = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican_service_user.auth_type = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican_service_user.cafile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican_service_user.certfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican_service_user.collect_timing = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican_service_user.insecure = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican_service_user.keyfile = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican_service_user.split_loggers = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] barbican_service_user.timeout = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.approle_role_id = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.approle_secret_id = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.auth_method = approle {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.auth_path = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.kv_mountpoint = secret {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.kv_path = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.kv_version = 2 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.namespace = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.root_token_id = **** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.ssl_ca_crt_file = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.timeout = 60.0 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.token_file = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.token_role = None {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.use_ssl = False {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 01 02:00:47 devstack cinder-volume[87060]: DEBUG oslo_service.backend._eventlet.service [None req-c208784f-b0f7-4681-b8d2-6f4f90b7551f None None] ******************************************************************************** {{(pid=87060) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:47 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:00:47 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:47 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.259s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:47 devstack cinder-volume[87389]: INFO cinder.volume.driver [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Driver hasn't implemented _init_vendor_properties() Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.volume.driver [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0478439331055, 'free_capacity_gb': 1774.0478439331055, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87389) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_db.sqlalchemy.engines [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87389) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writer thread running {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.db.api [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Building query based on filter {{(pid=87389) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87389) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:47 devstack cinder-volume[87389]: INFO cinder.keymgr.migration [None req-f0bd8b80-8f55-47c7-b9a4-86f34120ce5e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 01 02:00:47 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:00:47 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:47 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.245s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:00:47 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Driver initialization completed successfully. Sep 01 02:00:47 devstack cinder-volume[87389]: INFO cinder.manager [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Initiating service 3 cleanup Sep 01 02:00:47 devstack cinder-volume[87389]: INFO cinder.manager [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Service 3 cleanup completed. Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.service [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Creating RPC server for service cinder-volume {{(pid=87389) start /opt/stack/cinder/cinder/service.py:231}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.service [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87389) start /opt/stack/cinder/cinder/service.py:237}} Sep 01 02:00:47 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:00:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:00:47 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:00:47 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:00:48 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Sep 01 02:00:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.241s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:00:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3e783d90-468c-4e6a-a762-541383da9e94 None None] Driver post RPC initialization completed successfully. Sep 01 02:00:56 devstack cinder-volume[87060]: DEBUG dbcounter [-] [87060] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87060) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:57 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:00:58 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=2 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:01:47 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:01:47 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:01:47 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.362s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 6 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:01:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:02:11 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Flow 'volume_create_manager' (be858e73-0303-4917-a04e-5875c1513a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15935e1b-58ff-45f5-9c42-e8b67afbd8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15935e1b-58ff-45f5-9c42-e8b67afbd8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1766469779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fce33f-fef5-4d81-89df-ce756656d02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31a5f012d984a8bb973f9c20d9e883d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:12Z,use_quota=True,user_id='7d7172efea65484688e41c4b83884303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555c8e9b-4f91-45bf-b5c4-0670962ad9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (555c8e9b-4f91-45bf-b5c4-0670962ad9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef778b8-0efa-47cf-ad2f-dc3d82b6b9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef778b8-0efa-47cf-ad2f-dc3d82b6b9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50fce33f-fef5-4d81-89df-ce756656d02e', 'volume_name': 'volume-50fce33f-fef5-4d81-89df-ce756656d02e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c068c2-0854-4ec6-b213-56851f02235f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c068c2-0854-4ec6-b213-56851f02235f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7ed346-55bc-4539-bf76-c3551a4574ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:12 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Volume 50fce33f-fef5-4d81-89df-ce756656d02e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50fce33f-fef5-4d81-89df-ce756656d02e', 'volume_size': 1} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1766469779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50fce33f-fef5-4d81-89df-ce756656d02e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31a5f012d984a8bb973f9c20d9e883d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:12Z,use_quota=True,user_id='7d7172efea65484688e41c4b83884303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Creating volume 50fce33f-fef5-4d81-89df-ce756656d02e {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:12 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:02:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:12 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e 1073741824 Sep 01 02:02:12 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:14 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e 1073741824" returned: 0 in 1.846s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:14 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e Sep 01 02:02:14 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:15 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e" returned: 0 in 0.752s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] <== create_volume: return (2774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.777s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e7ed346-55bc-4539-bf76-c3551a4574ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50fce33f-fef5-4d81-89df-ce756656d02e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141a94c7-f169-4b05-8f8a-234bd8be7aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:15 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Volume volume-50fce33f-fef5-4d81-89df-ce756656d02e (50fce33f-fef5-4d81-89df-ce756656d02e): created successfully Sep 01 02:02:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (141a94c7-f169-4b05-8f8a-234bd8be7aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Flow 'volume_create_manager' (be858e73-0303-4917-a04e-5875c1513a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:15 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b07ae883-44e0-4e2c-b434-32f8484941e3 tempest-VolumesAdminNegativeTest-1766015551 None] Created volume successfully. Sep 01 02:02:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Acquiring lock "cinder-50fce33f-fef5-4d81-89df-ce756656d02e-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Lock "cinder-50fce33f-fef5-4d81-89df-ce756656d02e-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Acquiring lock "cinder-quobyte-50fce33f-fef5-4d81-89df-ce756656d02e" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:02:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Lock "cinder-quobyte-50fce33f-fef5-4d81-89df-ce756656d02e" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:02:16 devstack cinder-volume[87389]: INFO oslo.privsep.daemon [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpg_werqw5/privsep.sock'] Sep 01 02:02:16 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpg_werqw5/privsep.sock Sep 01 02:02:16 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:17 devstack cinder-volume[87389]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 01 02:02:17 devstack cinder-volume[87389]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 01 02:02:17 devstack cinder-volume[87389]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 01 02:02:17 devstack cinder-volume[87389]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 02:02:17 devstack cinder-volume[87389]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 01 02:02:17 devstack cinder-volume[87389]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 01 02:02:17 devstack cinder-volume[87389]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 01 02:02:17 devstack cinder-volume[87389]: WARNING oslo.privsep.daemon [-] privsep log: Sep 01 02:02:17 devstack cinder-volume[87389]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 01 02:02:17 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:17 devstack cinder-volume[87389]: INFO oslo.privsep.daemon [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Spawned new privsep daemon via rootwrap Sep 01 02:02:17 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Accepted privsep connection to /tmp/tmpg_werqw5/privsep.sock {{(pid=87389) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 01 02:02:17 devstack cinder-volume[87389]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 01 02:02:17 devstack cinder-volume[87389]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 01 02:02:17 devstack cinder-volume[87389]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 01 02:02:17 devstack cinder-volume[87389]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88409 Sep 01 02:02:17 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a695e025-56c8-45c0-90a6-1a762f667a00]: (2,) {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:17 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[715007ab-772b-4417-bc3d-c5bd3304d3fb]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:02:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:18 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e Sep 01 02:02:18 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:18 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e" returned: 0 in 0.757s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:18 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e Sep 01 02:02:18 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:19 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-50fce33f-fef5-4d81-89df-ce756656d02e" returned: 0 in 0.600s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Lock "cinder-quobyte-50fce33f-fef5-4d81-89df-ce756656d02e" released by "delete_volume" :: held 3.359s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:19 devstack cinder-volume[87389]: WARNING cinder.quota [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:02:19 devstack cinder-volume[87389]: WARNING cinder.quota [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:02:19 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Created reservations ['8e236289-d30f-4b93-9f9b-5e5f16ba6de3', '6798d793-4fdb-424b-b9a8-9d8340fd1ad1', '164fe58e-b0df-4249-b568-6cc06e48ca4a', '1790637e-bbf0-40a3-a675-c48e0beaeb88'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:02:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:19 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:02:19 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:20 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.486s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:20 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Deleted volume successfully. Sep 01 02:02:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b72b7f5a-5413-419e-93ac-54512a38ad0a tempest-VolumesAdminNegativeTest-1766015551 None] Lock "cinder-50fce33f-fef5-4d81-89df-ce756656d02e-delete_volume" released by "delete_volume" :: held 4.393s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:02:29 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:30 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=13,cinder:DELETE=2,cinder:SELECT=4,cinder:INSERT=2 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Flow 'volume_create_manager' (eb3d68a2-dae7-4d67-b8fa-9a66a1b7d40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b97392f-83c6-4e42-95c2-7917cef94a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b97392f-83c6-4e42-95c2-7917cef94a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-480201522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d939fd3d-b14f-4557-8445-a28e2cf9513c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4503252cdad9431c8a61676585257eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:43Z,use_quota=True,user_id='1d69ed458fc14963a1489c3a950f4d45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6ca92f-51c6-48f3-ba9d-3960cea72f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6ca92f-51c6-48f3-ba9d-3960cea72f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d28a458-5eed-4fcd-a0cf-2d0c0f014527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d28a458-5eed-4fcd-a0cf-2d0c0f014527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd939fd3d-b14f-4557-8445-a28e2cf9513c', 'volume_name': 'volume-d939fd3d-b14f-4557-8445-a28e2cf9513c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13af2709-6153-4923-85cb-30251dae7582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13af2709-6153-4923-85cb-30251dae7582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d28837-9050-4748-a824-c0761b0ca898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:43 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Volume d939fd3d-b14f-4557-8445-a28e2cf9513c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d939fd3d-b14f-4557-8445-a28e2cf9513c', 'volume_size': 1} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-480201522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d939fd3d-b14f-4557-8445-a28e2cf9513c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4503252cdad9431c8a61676585257eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:43Z,use_quota=True,user_id='1d69ed458fc14963a1489c3a950f4d45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Creating volume d939fd3d-b14f-4557-8445-a28e2cf9513c {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:43 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:02:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:43 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c 1073741824 Sep 01 02:02:43 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:44 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c 1073741824" returned: 0 in 1.068s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:44 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c Sep 01 02:02:44 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:45 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c" returned: 0 in 0.631s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6d28837-9050-4748-a824-c0761b0ca898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d939fd3d-b14f-4557-8445-a28e2cf9513c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ea7c66-8b7c-430a-8959-7f34f29102e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:45 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Volume volume-d939fd3d-b14f-4557-8445-a28e2cf9513c (d939fd3d-b14f-4557-8445-a28e2cf9513c): created successfully Sep 01 02:02:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7ea7c66-8b7c-430a-8959-7f34f29102e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Flow 'volume_create_manager' (eb3d68a2-dae7-4d67-b8fa-9a66a1b7d40b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:45 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-207f2ea4-37c0-41ef-82ca-1910eb834329 tempest-AttachVolumeShelveTestJSON-670085349 None] Created volume successfully. Sep 01 02:02:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:02:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:47 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:02:47 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:48 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.783s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:48 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:02:48 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:02:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 8 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:02:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Flow 'volume_create_manager' (eff91719-0d9a-4aa8-9da9-ad83b3c146bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ba56e1-2340-45ce-aabc-fcbde6f2e18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7ba56e1-2340-45ce-aabc-fcbde6f2e18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1575479964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306836ae-8cb6-4d34-bf42-220390934b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9af50f24744c459b4488a9a2aa0910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:51Z,use_quota=True,user_id='56e43f199e9f4a9fbb076dce0fd9dc21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de2c4ab-bd24-4e92-b042-bcc5a3fc201d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de2c4ab-bd24-4e92-b042-bcc5a3fc201d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451cbcba-d1ad-4061-b094-35433c778d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (451cbcba-d1ad-4061-b094-35433c778d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '306836ae-8cb6-4d34-bf42-220390934b9a', 'volume_name': 'volume-306836ae-8cb6-4d34-bf42-220390934b9a', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4515518f-616c-4137-95d8-47b86002dc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4515518f-616c-4137-95d8-47b86002dc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78ac97b-7219-4ceb-b0c9-e58b8b538409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:50 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Volume 306836ae-8cb6-4d34-bf42-220390934b9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-306836ae-8cb6-4d34-bf42-220390934b9a', 'volume_size': 1} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:02:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1575479964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=306836ae-8cb6-4d34-bf42-220390934b9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9af50f24744c459b4488a9a2aa0910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:02:51Z,use_quota=True,user_id='56e43f199e9f4a9fbb076dce0fd9dc21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Creating volume 306836ae-8cb6-4d34-bf42-220390934b9a {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:02:50 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:02:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:50 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a 1073741824 Sep 01 02:02:50 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:52 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a 1073741824" returned: 0 in 1.242s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:02:52 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a Sep 01 02:02:52 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:02:52 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Sep 01 02:02:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a" returned: 0 in 0.529s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:02:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:02:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:02:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a78ac97b-7219-4ceb-b0c9-e58b8b538409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-306836ae-8cb6-4d34-bf42-220390934b9a', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cf6cfd-4983-450e-8c12-7db2835cac68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:02:52 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Volume volume-306836ae-8cb6-4d34-bf42-220390934b9a (306836ae-8cb6-4d34-bf42-220390934b9a): created successfully Sep 01 02:02:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4cf6cfd-4983-450e-8c12-7db2835cac68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:02:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Flow 'volume_create_manager' (eff91719-0d9a-4aa8-9da9-ad83b3c146bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:02:52 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a54a913c-cdd9-4119-bcae-ca192845de57 tempest-ServerActionsTestOtherA-874258025 None] Created volume successfully. Sep 01 02:03:02 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:02 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=4,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Flow 'volume_create_manager' (ad245314-c88e-4872-9c97-0500dc15564f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936e5fe4-cad7-4cab-bdf8-f3244e5ee0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936e5fe4-cad7-4cab-bdf8-f3244e5ee0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1066187900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbf5821-5d9b-4dee-adda-60b29c3e7ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9038e9e8564272964e29378a773f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:07Z,use_quota=True,user_id='0f55daeaa9a64395adf1e248f67872b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c6c729-d80a-4027-af7f-c36f4d03dd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7c6c729-d80a-4027-af7f-c36f4d03dd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3807f3-91fa-4694-8af6-7226064801e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de3807f3-91fa-4694-8af6-7226064801e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edbf5821-5d9b-4dee-adda-60b29c3e7ff2', 'volume_name': 'volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75fb35f-e390-45c5-b609-362ec1454831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a75fb35f-e390-45c5-b609-362ec1454831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4364f93-dcc0-4690-8840-f19dc1ddaf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:07 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Volume edbf5821-5d9b-4dee-adda-60b29c3e7ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2', 'volume_size': 1} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1066187900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbf5821-5d9b-4dee-adda-60b29c3e7ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a9038e9e8564272964e29378a773f75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:07Z,use_quota=True,user_id='0f55daeaa9a64395adf1e248f67872b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Creating volume edbf5821-5d9b-4dee-adda-60b29c3e7ff2 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:07 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:03:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:07 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2 1073741824 Sep 01 02:03:07 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:08 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2 1073741824" returned: 0 in 1.016s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:08 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2 Sep 01 02:03:08 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:09 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2" returned: 0 in 0.577s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4364f93-dcc0-4690-8840-f19dc1ddaf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa255119-c81a-48a6-aa2e-bdd065707080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:09 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Volume volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2 (edbf5821-5d9b-4dee-adda-60b29c3e7ff2): created successfully Sep 01 02:03:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa255119-c81a-48a6-aa2e-bdd065707080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Flow 'volume_create_manager' (ad245314-c88e-4872-9c97-0500dc15564f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:09 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-aef0393a-5c3d-46db-859c-c431c3c0840d tempest-ServerRescueNegativeTestJSON-539207822 None] Created volume successfully. Sep 01 02:03:10 devstack cinder-volume[87389]: WARNING py.warnings [req-b2fc86fa-4efa-4cf7-8120-a166f0d1c176 req-864cfbbf-5338-47d5-8a02-b4ed020d3cca tempest-AttachVolumeShelveTestJSON-670085349 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 01 02:03:10 devstack cinder-volume[87389]: .first() Sep 01 02:03:10 devstack cinder-volume[87389]: Sep 01 02:03:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-b2fc86fa-4efa-4cf7-8120-a166f0d1c176 req-864cfbbf-5338-47d5-8a02-b4ed020d3cca tempest-AttachVolumeShelveTestJSON-670085349 None] No connector for attachment f8f18fab-66bd-4bfd-b22e-c83363fe9c48; skipping storage backend terminate_connection call. {{(pid=87389) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 01 02:03:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-b2fc86fa-4efa-4cf7-8120-a166f0d1c176 req-864cfbbf-5338-47d5-8a02-b4ed020d3cca tempest-AttachVolumeShelveTestJSON-670085349 None] Deleting attachment f8f18fab-66bd-4bfd-b22e-c83363fe9c48. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:03:19 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=1,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:20 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:03:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Acquiring lock "cinder-edbf5821-5d9b-4dee-adda-60b29c3e7ff2-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Lock "cinder-edbf5821-5d9b-4dee-adda-60b29c3e7ff2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Acquiring lock "cinder-quobyte-edbf5821-5d9b-4dee-adda-60b29c3e7ff2" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Lock "cinder-quobyte-edbf5821-5d9b-4dee-adda-60b29c3e7ff2" acquired by "delete_volume" :: waited 0.031s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:29 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f30f8f2-6fa7-4817-8c81-5ca7a8c013fe]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:29 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2 Sep 01 02:03:29 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:30 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2" returned: 0 in 0.886s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:30 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2 Sep 01 02:03:30 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:30 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-edbf5821-5d9b-4dee-adda-60b29c3e7ff2" returned: 0 in 0.449s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Lock "cinder-quobyte-edbf5821-5d9b-4dee-adda-60b29c3e7ff2" released by "delete_volume" :: held 1.467s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:30 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Created reservations ['a4d0f88b-eeeb-486c-b8bd-21d773957ee6', '36766153-5373-4d89-ad5e-78cd1a130697', 'bf8c0068-82f3-41f1-a002-90a650e5026d', '6398da3b-c0a7-4b55-b6cf-9547a0b98c71'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:31 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:03:31 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:03:31 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Flow 'volume_create_manager' (8ce580c8-8004-434d-b00e-0535840aae4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0507888-b6b7-4c13-9ac2-0f37e3555d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.585s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0507888-b6b7-4c13-9ac2-0f37e3555d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-639628967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d178f7-53f1-49eb-ad5e-9fd3cfece8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f928c624de14bd6aa938aac5932c9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:32Z,use_quota=True,user_id='7012f6adc00a4c9488a68699ddd4817b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71206dee-e2cd-44ae-aa47-ab617ea044ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71206dee-e2cd-44ae-aa47-ab617ea044ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407dde3e-1219-40e5-af6f-56b91d325260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407dde3e-1219-40e5-af6f-56b91d325260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02d178f7-53f1-49eb-ad5e-9fd3cfece8d5', 'volume_name': 'volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29dc3147-0922-40b8-a336-6a0e05bf3fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29dc3147-0922-40b8-a336-6a0e05bf3fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498fc7ba-bd21-4838-b031-22f3468b8922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:31 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Volume 02d178f7-53f1-49eb-ad5e-9fd3cfece8d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5', 'volume_size': 1} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-639628967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02d178f7-53f1-49eb-ad5e-9fd3cfece8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f928c624de14bd6aa938aac5932c9f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:03:32Z,use_quota=True,user_id='7012f6adc00a4c9488a68699ddd4817b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Creating volume 02d178f7-53f1-49eb-ad5e-9fd3cfece8d5 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:03:31 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:31 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Deleted volume successfully. Sep 01 02:03:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-39fb255b-e2b6-4648-89ce-6ce24df0e05e tempest-ServerRescueNegativeTestJSON-539207822 None] Lock "cinder-edbf5821-5d9b-4dee-adda-60b29c3e7ff2-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:31 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5 1073741824 Sep 01 02:03:31 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:33 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5 1073741824" returned: 0 in 1.240s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:33 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5 Sep 01 02:03:33 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:33 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5" returned: 0 in 0.616s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:03:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498fc7ba-bd21-4838-b031-22f3468b8922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ba4610-7008-449b-84a8-296fb16adb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:03:33 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Volume volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5 (02d178f7-53f1-49eb-ad5e-9fd3cfece8d5): created successfully Sep 01 02:03:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ba4610-7008-449b-84a8-296fb16adb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:03:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Flow 'volume_create_manager' (8ce580c8-8004-434d-b00e-0535840aae4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:03:33 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6f8382d2-abb6-41d4-91d7-f184f6b35dc7 tempest-DeleteServersTestJSON-1397290161 None] Created volume successfully. Sep 01 02:03:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-ae46e834-c2c8-4656-83cc-3167ee0b757d req-d8498d50-8d6e-44c9-a1cd-87e9994b70c0 tempest-DeleteServersTestJSON-1397290161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-ae46e834-c2c8-4656-83cc-3167ee0b757d req-d8498d50-8d6e-44c9-a1cd-87e9994b70c0 tempest-DeleteServersTestJSON-1397290161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-ae46e834-c2c8-4656-83cc-3167ee0b757d req-d8498d50-8d6e-44c9-a1cd-87e9994b70c0 tempest-DeleteServersTestJSON-1397290161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-ae46e834-c2c8-4656-83cc-3167ee0b757d req-d8498d50-8d6e-44c9-a1cd-87e9994b70c0 tempest-DeleteServersTestJSON-1397290161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6342001b-7b2e-45e8-94a7-c7b32de1f215', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:03:42 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-ae46e834-c2c8-4656-83cc-3167ee0b757d req-d8498d50-8d6e-44c9-a1cd-87e9994b70c0 tempest-DeleteServersTestJSON-1397290161 None] attachment_update completed successfully. Sep 01 02:03:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-233e4458-1cbf-42ca-8fa3-e5e4c408b97a req-66763cef-a72b-434f-a2c8-8b0856d91081 tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-233e4458-1cbf-42ca-8fa3-e5e4c408b97a req-66763cef-a72b-434f-a2c8-8b0856d91081 tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-233e4458-1cbf-42ca-8fa3-e5e4c408b97a req-66763cef-a72b-434f-a2c8-8b0856d91081 tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-233e4458-1cbf-42ca-8fa3-e5e4c408b97a req-66763cef-a72b-434f-a2c8-8b0856d91081 tempest-ServerActionsTestOtherA-874258025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-306836ae-8cb6-4d34-bf42-220390934b9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4363a0e1-8663-4823-b72e-3cf46aa3daca', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:03:43 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-233e4458-1cbf-42ca-8fa3-e5e4c408b97a req-66763cef-a72b-434f-a2c8-8b0856d91081 tempest-ServerActionsTestOtherA-874258025 None] attachment_update completed successfully. Sep 01 02:03:47 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-e322eb78-a89e-47da-9f83-5850d333e1a6 req-01f6a7b7-8be3-4429-9a23-df8b9c054a19 tempest-DeleteServersTestJSON-1397290161 None] Terminate volume connection completed successfully. Sep 01 02:03:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-e322eb78-a89e-47da-9f83-5850d333e1a6 req-01f6a7b7-8be3-4429-9a23-df8b9c054a19 tempest-DeleteServersTestJSON-1397290161 None] Deleting attachment 6342001b-7b2e-45e8-94a7-c7b32de1f215. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:03:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-20b8d45f-cd68-4f09-8bf8-a89121c406d9 req-d5528563-ea5d-45eb-a90b-a3eeda0f244e tempest-ServerActionsTestOtherA-874258025 None] Terminate volume connection completed successfully. Sep 01 02:03:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-20b8d45f-cd68-4f09-8bf8-a89121c406d9 req-d5528563-ea5d-45eb-a90b-a3eeda0f244e tempest-ServerActionsTestOtherA-874258025 None] Deleting attachment 4363a0e1-8663-4823-b72e-3cf46aa3daca. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:03:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-20b8d45f-cd68-4f09-8bf8-a89121c406d9 req-00b6dce4-5f7c-4ac8-ac0e-01fcc2419e2e tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-20b8d45f-cd68-4f09-8bf8-a89121c406d9 req-00b6dce4-5f7c-4ac8-ac0e-01fcc2419e2e tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-20b8d45f-cd68-4f09-8bf8-a89121c406d9 req-00b6dce4-5f7c-4ac8-ac0e-01fcc2419e2e tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-20b8d45f-cd68-4f09-8bf8-a89121c406d9 req-00b6dce4-5f7c-4ac8-ac0e-01fcc2419e2e tempest-ServerActionsTestOtherA-874258025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-306836ae-8cb6-4d34-bf42-220390934b9a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b83003e9-95be-4299-b84a-516ecbe3b2c6', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:03:49 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-20b8d45f-cd68-4f09-8bf8-a89121c406d9 req-00b6dce4-5f7c-4ac8-ac0e-01fcc2419e2e tempest-ServerActionsTestOtherA-874258025 None] attachment_update completed successfully. Sep 01 02:03:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Acquiring lock "cinder-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Lock "cinder-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Acquiring lock "cinder-quobyte-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:03:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Lock "cinder-quobyte-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5" acquired by "delete_volume" :: waited 0.034s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:03:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[61575102-6b93-42be-a800-811f18dff4d7]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:03:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:51 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5 Sep 01 02:03:51 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:51 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5" returned: 0 in 0.782s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:51 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5 Sep 01 02:03:51 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:52 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5" returned: 0 in 0.544s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Lock "cinder-quobyte-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5" released by "delete_volume" :: held 1.427s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:03:52 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Created reservations ['52986e47-b92d-4f9c-a856-7aa8c2451354', '461dad8d-4dd2-4ee7-b253-55bd1261f24f', '46843632-24a1-49cb-b778-7f9f10bd10bb', '6069cb59-b587-48bd-aa50-31778246f993'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:03:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:03:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:03:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:03:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:03:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:03:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:03:52 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:03:52 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:03:53 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Sep 01 02:03:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.479s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:03:53 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:03:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Deleted volume successfully. Sep 01 02:03:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aa9dd662-89bb-4f8a-92a8-cd8422d5c68f tempest-DeleteServersTestJSON-1397290161 None] Lock "cinder-02d178f7-53f1-49eb-ad5e-9fd3cfece8d5-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:02 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=26,cinder:SELECT=34,cinder:INSERT=3 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:03 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=33,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=3 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Acquiring lock "cinder-d939fd3d-b14f-4557-8445-a28e2cf9513c-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Lock "cinder-d939fd3d-b14f-4557-8445-a28e2cf9513c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Acquiring lock "cinder-quobyte-d939fd3d-b14f-4557-8445-a28e2cf9513c" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Lock "cinder-quobyte-d939fd3d-b14f-4557-8445-a28e2cf9513c" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:14 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e003e72f-de12-4c82-99d8-359df37f900d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:14 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c Sep 01 02:04:14 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:15 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c" returned: 0 in 0.429s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:15 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c Sep 01 02:04:15 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:15 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d939fd3d-b14f-4557-8445-a28e2cf9513c" returned: 0 in 0.322s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Lock "cinder-quobyte-d939fd3d-b14f-4557-8445-a28e2cf9513c" released by "delete_volume" :: held 0.815s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:15 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Created reservations ['cb11bc8f-3c4d-4418-8ab6-33fe2f605c1a', '16dcec1b-f5cf-4a72-a606-a0c266208c7d', '0b48bce2-d8d0-4f54-8b8d-f153d44f8840', 'e024fe8b-fd28-44ec-a421-8cb76b05da37'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:15 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:04:15 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:16 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.357s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:16 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:16 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Deleted volume successfully. Sep 01 02:04:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5002fe6c-fde2-48fd-b106-1ee82743170a tempest-AttachVolumeShelveTestJSON-670085349 None] Lock "cinder-d939fd3d-b14f-4557-8445-a28e2cf9513c-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:25 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:26 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=6,cinder:SELECT=4,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:26 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-9a0abe4a-1d35-48c4-94d2-cd75200cca0d req-73cf3d3e-8880-4b3a-88a5-ca7ce2230f1d tempest-ServerActionsTestOtherA-874258025 None] Terminate volume connection completed successfully. Sep 01 02:04:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9a0abe4a-1d35-48c4-94d2-cd75200cca0d req-73cf3d3e-8880-4b3a-88a5-ca7ce2230f1d tempest-ServerActionsTestOtherA-874258025 None] Deleting attachment b83003e9-95be-4299-b84a-516ecbe3b2c6. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:04:36 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=2 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:04:38 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-30397522-8dce-40a4-a4e0-871656365b0d tempest-GroupSnapshotsV319Test-155292452 None] Group tempest-GroupSnapshotsV319Test-Group-1449881458: creating Sep 01 02:04:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-30397522-8dce-40a4-a4e0-871656365b0d tempest-GroupSnapshotsV319Test-155292452 None] Group tempest-GroupSnapshotsV319Test-Group-1449881458: created successfully Sep 01 02:04:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-30397522-8dce-40a4-a4e0-871656365b0d tempest-GroupSnapshotsV319Test-155292452 None] Create group completed successfully. Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Flow 'volume_create_manager' (f2e66578-2e76-4ccc-be03-f312d65af2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5906f6-bc93-4b83-a212-35eb0fb1e854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf5906f6-bc93-4b83-a212-35eb0fb1e854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2054450051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a0f57f-fcee-4c70-b171-863727c5241a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9af50f24744c459b4488a9a2aa0910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:39Z,use_quota=True,user_id='56e43f199e9f4a9fbb076dce0fd9dc21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f8858a-28fb-477b-b921-16a34dca196d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7f8858a-28fb-477b-b921-16a34dca196d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf9b079-f47a-4c83-941f-668f7df71391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.image.glance [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Creating Keystone auth plugin from conf {{(pid=87389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf9b079-f47a-4c83-941f-668f7df71391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a1a0f57f-fcee-4c70-b171-863727c5241a', 'volume_name': 'volume-a1a0f57f-fcee-4c70-b171-863727c5241a', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4785ed-6bef-4787-8adc-ee8e5a94d55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4785ed-6bef-4787-8adc-ee8e5a94d55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63af980-1ab1-481b-9b2e-5cea78223904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:39 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Volume a1a0f57f-fcee-4c70-b171-863727c5241a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a1a0f57f-fcee-4c70-b171-863727c5241a', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:04:39 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Trying to clone a1a0f57f-fcee-4c70-b171-863727c5241a from image 97f1460d-e99d-469e-a933-615f59c7b55c at location (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]). {{(pid=87389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:04:40 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:04:40 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:04:40 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a246332-e695-4cae-b7d6-6cd5dbe38afa]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:40 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD Sep 01 02:04:40 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:40 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD" returned: 0 in 0.461s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:40 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Temporary image 97f1460d-e99d-469e-a933-615f59c7b55c is fetched for user 56e43f199e9f4a9fbb076dce0fd9dc21. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:04:40 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac66973-1955-40a9-95ef-7427b9bde0c9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Flow 'volume_create_manager' (5f015132-359c-4076-9766-a04c449f7f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9da2349-7c23-4b43-b1e4-3dbb0ec4982e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9da2349-7c23-4b43-b1e4-3dbb0ec4982e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-45030413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5668db74-c623-4d7e-9f79-1ce91884d0f2,host='devstack@QuobyteHD#QuobyteHD',id=b83ea2ad-95eb-4afa-9d58-4347115b5e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc252064a5774de2b618cffb8ccaf775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:41Z,use_quota=True,user_id='197ad4fe584a47f99fad90c785aee448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c12fcf-ca00-42c2-9de7-d925bd8f19f0),volume_type_id=84c12fcf-ca00-42c2-9de7-d925bd8f19f0)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf76d63a-fd34-4325-8a7a-3d6b5c252348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf76d63a-fd34-4325-8a7a-3d6b5c252348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95051d4-5542-4263-858e-1a6f099ea0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f95051d4-5542-4263-858e-1a6f099ea0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b83ea2ad-95eb-4afa-9d58-4347115b5e4e', 'volume_name': 'volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD Sep 01 02:04:41 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d47047-8c13-4b2a-88d8-21de120838db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d47047-8c13-4b2a-88d8-21de120838db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dae7466-76be-49e6-88bf-49421fbf010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:41 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Volume b83ea2ad-95eb-4afa-9d58-4347115b5e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e', 'volume_size': 1} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5668db74-c623-4d7e-9f79-1ce91884d0f2,created_at=2026-09-01T00:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-45030413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5668db74-c623-4d7e-9f79-1ce91884d0f2,host='devstack@QuobyteHD#QuobyteHD',id=b83ea2ad-95eb-4afa-9d58-4347115b5e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc252064a5774de2b618cffb8ccaf775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:41Z,use_quota=True,user_id='197ad4fe584a47f99fad90c785aee448',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84c12fcf-ca00-42c2-9de7-d925bd8f19f0),volume_type_id=84c12fcf-ca00-42c2-9de7-d925bd8f19f0)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Creating volume b83ea2ad-95eb-4afa-9d58-4347115b5e4e {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:41 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:41 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e 1073741824 Sep 01 02:04:41 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:41 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD" returned: 0 in 0.536s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:41 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e 1073741824" returned: 0 in 0.660s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:41 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e Sep 01 02:04:41 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:41 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Flow 'volume_create_manager' (62b595e6-57b6-483c-8f99-b97b6d65202d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c45fbf6-b650-417f-9d19-3b6119be8bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c45fbf6-b650-417f-9d19-3b6119be8bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-416277668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8569e3ef-958e-43e5-a0a8-ad87982677aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f543a9289dc4f68bf1d6afe6c4727c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:42Z,use_quota=True,user_id='7d12acbe86ed40178c7d43a1ff6e6ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d38b7d7-475b-429b-9dd2-3dac6a75c4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d38b7d7-475b-429b-9dd2-3dac6a75c4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbfc85d-c8ab-4c2b-8ccd-18c148c8206a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bbfc85d-c8ab-4c2b-8ccd-18c148c8206a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8569e3ef-958e-43e5-a0a8-ad87982677aa', 'volume_name': 'volume-8569e3ef-958e-43e5-a0a8-ad87982677aa', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1bae3b-25fd-4f73-a253-132008979ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d1bae3b-25fd-4f73-a253-132008979ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2aaf5ec-37dc-47fc-8d52-d803556fb2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:42 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Volume 8569e3ef-958e-43e5-a0a8-ad87982677aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8569e3ef-958e-43e5-a0a8-ad87982677aa', 'volume_size': 1} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:42 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e" returned: 0 in 0.276s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2054450051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a0f57f-fcee-4c70-b171-863727c5241a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9af50f24744c459b4488a9a2aa0910',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:39Z,use_quota=True,user_id='56e43f199e9f4a9fbb076dce0fd9dc21',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Creating volume a1a0f57f-fcee-4c70-b171-863727c5241a {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:42 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dae7466-76be-49e6-88bf-49421fbf010a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:42 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a 1073741824 Sep 01 02:04:42 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e644ca-8a52-4a60-bf26-67e8f31b1ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:42 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Volume volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e (b83ea2ad-95eb-4afa-9d58-4347115b5e4e): created successfully Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e644ca-8a52-4a60-bf26-67e8f31b1ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Flow 'volume_create_manager' (5f015132-359c-4076-9766-a04c449f7f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:42 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-71f747fb-56e9-4046-bf31-f29a1c5201aa tempest-GroupSnapshotsV319Test-155292452 None] Created volume successfully. Sep 01 02:04:42 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a 1073741824" returned: 0 in 0.465s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:42 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a Sep 01 02:04:42 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:43 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a" returned: 0 in 0.264s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-416277668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8569e3ef-958e-43e5-a0a8-ad87982677aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f543a9289dc4f68bf1d6afe6c4727c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:42Z,use_quota=True,user_id='7d12acbe86ed40178c7d43a1ff6e6ca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Creating volume 8569e3ef-958e-43e5-a0a8-ad87982677aa {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:43 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:43 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa 1073741824 Sep 01 02:04:43 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Attempting download of 97f1460d-e99d-469e-a933-615f59c7b55c ((None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}])) to volume a1a0f57f-fcee-4c70-b171-863727c5241a. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[407bf8d6-df54-4f3f-9a66-9abf48d1f0e8]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ltlpodcr {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:43 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ltlpodcr Sep 01 02:04:43 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:43 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ltlpodcr" returned: 0 in 0.347s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ltlpodcr {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:43 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa 1073741824" returned: 0 in 0.462s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:43 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa Sep 01 02:04:43 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:43 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ltlpodcr Sep 01 02:04:43 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:43 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa" returned: 0 in 0.295s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2aaf5ec-37dc-47fc-8d52-d803556fb2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8569e3ef-958e-43e5-a0a8-ad87982677aa', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:43 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c49456-e4bc-4632-a140-4a1079bfc629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ltlpodcr" returned: 1 in 0.394s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ltlpodcr' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[324a67a5-9aa2-4f75-92fa-23b516e684d8]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:43 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Volume volume-8569e3ef-958e-43e5-a0a8-ad87982677aa (8569e3ef-958e-43e5-a0a8-ad87982677aa): created successfully Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c49456-e4bc-4632-a140-4a1079bfc629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Flow 'volume_create_manager' (62b595e6-57b6-483c-8f99-b97b6d65202d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:43 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] GroupSnapshot 5a35610b-fdc5-45f5-84f1-78b4b51111e0: creating. Sep 01 02:04:43 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-aaf00843-a148-41c5-97f1-440628a03fdb tempest-TaggedAttachmentsTest-1886990824 None] Created volume successfully. Sep 01 02:04:43 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD Sep 01 02:04:43 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] Group snapshot 5a35610b-fdc5-45f5-84f1-78b4b51111e0: creating. {{(pid=87389) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:04:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] Creating offline snapshot 326eb740-866c-4f47-8ad3-7c94e3c3a9a8 of volume b83ea2ad-95eb-4afa-9d58-4347115b5e4e {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:04:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[48065bf1-c40f-4223-a9c6-1beff99be8a7]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:44 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e Sep 01 02:04:44 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:44 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:44 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] 97f1460d-e99d-469e-a933-615f59c7b55c was qcow2, converting to qcow2 {{(pid=87389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:04:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:44 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a Sep 01 02:04:44 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:44 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e" returned: 0 in 0.427s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:44 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 1G Sep 01 02:04:44 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 1G" returned: 0 in 0.527s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 Sep 01 02:04:45 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8" returned: 0 in 0.359s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:04:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 Sep 01 02:04:45 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:45 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8" returned: 0 in 0.259s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:45 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.info Sep 01 02:04:45 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.info" returned: 0 in 0.323s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:46 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.info Sep 01 02:04:46 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.info" returned: 0 in 0.332s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.340s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a" returned: 0 in 2.165s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_m3u833s9devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:04:46 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Converted 112.00 MB image at 51.71 MB/s Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:46 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a 1G Sep 01 02:04:46 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:46 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2618b486-28ea-4bf0-8c05-7ef7f5c61c7f tempest-GroupSnapshotsV319Test-155292452 None] group_snapshot 5a35610b-fdc5-45f5-84f1-78b4b51111e0: created successfully Sep 01 02:04:46 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a 1G" returned: 0 in 0.345s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Downloaded image 97f1460d-e99d-469e-a933-615f59c7b55c ((None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}])) to volume a1a0f57f-fcee-4c70-b171-863727c5241a successfully. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Temporary image 97f1460d-e99d-469e-a933-615f59c7b55c for user 56e43f199e9f4a9fbb076dce0fd9dc21 is deleted. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Marking volume a1a0f57f-fcee-4c70-b171-863727c5241a as bootable. {{(pid=87389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Copying metadata from image 97f1460d-e99d-469e-a933-615f59c7b55c to a1a0f57f-fcee-4c70-b171-863727c5241a. {{(pid=87389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Creating volume glance metadata for volume a1a0f57f-fcee-4c70-b171-863727c5241a backed by image 97f1460d-e99d-469e-a933-615f59c7b55c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63af980-1ab1-481b-9b2e-5cea78223904) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a0f57f-fcee-4c70-b171-863727c5241a', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc517c6d-cbcd-481d-9e8e-0c17a9dfd817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:46 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Volume volume-a1a0f57f-fcee-4c70-b171-863727c5241a (a1a0f57f-fcee-4c70-b171-863727c5241a): created successfully Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc517c6d-cbcd-481d-9e8e-0c17a9dfd817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Flow 'volume_create_manager' (f2e66578-2e76-4ccc-be03-f312d65af2a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:46 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-18865d2f-4ba2-4e6c-bfee-8035c105111e tempest-ServerActionsTestOtherA-874258025 None] Created volume successfully. Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:47 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:04:47 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:47 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.311s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:04:47 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] group_snapshot 5a35610b-fdc5-45f5-84f1-78b4b51111e0: deleting Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] group_snapshot 5a35610b-fdc5-45f5-84f1-78b4b51111e0: deleting {{(pid=87389) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Acquiring lock "cinder-quobyte-b83ea2ad-95eb-4afa-9d58-4347115b5e4e" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Lock "cinder-quobyte-b83ea2ad-95eb-4afa-9d58-4347115b5e4e" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Acquiring lock "cinder-quobyte-326eb740-866c-4f47-8ad3-7c94e3c3a9a8" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Lock "cinder-quobyte-326eb740-866c-4f47-8ad3-7c94e3c3a9a8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Deleting offline snapshot 326eb740-866c-4f47-8ad3-7c94e3c3a9a8 of volume b83ea2ad-95eb-4afa-9d58-4347115b5e4e {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] snapshot_file for this snap is: volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[927f3f56-5324-4017-aaf6-8ef7465b171b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:48 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 Sep 01 02:04:48 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:48 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8" returned: 0 in 0.615s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:04:48 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7123caf9-9f38-48a5-a258-368ed6866a62]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:48 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e Sep 01 02:04:48 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:49 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e" returned: 0 in 0.602s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:49 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 Sep 01 02:04:49 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:49 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8" returned: 0 in 0.584s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:49 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8 Sep 01 02:04:49 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:50 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e.326eb740-866c-4f47-8ad3-7c94e3c3a9a8" returned: 0 in 0.429s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Lock "cinder-quobyte-326eb740-866c-4f47-8ad3-7c94e3c3a9a8" released by "_delete_snapshot" :: held 2.382s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Lock "cinder-quobyte-b83ea2ad-95eb-4afa-9d58-4347115b5e4e" released by "delete_snapshot" :: held 2.408s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:50 devstack cinder-volume[87389]: WARNING cinder.quota [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-981083379 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-981083379, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:50 devstack cinder-volume[87389]: WARNING cinder.quota [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-981083379 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-981083379, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:50 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] Created reservations ['d9cd5c6a-dc55-4341-aa18-2799e995b346', '6e8e7861-6cda-4dbe-9c1d-d4a1c339681b', '102b0abd-18ac-4b23-868f-0153a21aefed', '3c0073a4-b752-4f51-8433-4ed7e72c1747'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:50 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c415d7d6-643c-459d-bea7-70a717b310ab tempest-GroupSnapshotsV319Test-155292452 None] group_snapshot 5a35610b-fdc5-45f5-84f1-78b4b51111e0: deleted successfully Sep 01 02:04:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Acquiring lock "cinder-quobyte-b83ea2ad-95eb-4afa-9d58-4347115b5e4e" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:04:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Lock "cinder-quobyte-b83ea2ad-95eb-4afa-9d58-4347115b5e4e" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:04:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfa53b1-a4b2-44f6-9479-8bb1eaeed5a4]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:04:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:52 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e Sep 01 02:04:52 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:52 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e" returned: 0 in 0.618s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:52 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e Sep 01 02:04:52 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-6929eb04-0bd1-417c-8af5-8e203f63900e req-7af8e6aa-ef37-474d-b685-9c6bac19f95c tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-6929eb04-0bd1-417c-8af5-8e203f63900e req-7af8e6aa-ef37-474d-b685-9c6bac19f95c tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-6929eb04-0bd1-417c-8af5-8e203f63900e req-7af8e6aa-ef37-474d-b685-9c6bac19f95c tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-6929eb04-0bd1-417c-8af5-8e203f63900e req-7af8e6aa-ef37-474d-b685-9c6bac19f95c tempest-ServerActionsTestOtherA-874258025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-a1a0f57f-fcee-4c70-b171-863727c5241a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c5353db0-1652-4eb1-bbd9-bcf9549a5c93', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:04:52 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-6929eb04-0bd1-417c-8af5-8e203f63900e req-7af8e6aa-ef37-474d-b685-9c6bac19f95c tempest-ServerActionsTestOtherA-874258025 None] attachment_update completed successfully. Sep 01 02:04:53 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b83ea2ad-95eb-4afa-9d58-4347115b5e4e" returned: 0 in 0.450s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Lock "cinder-quobyte-b83ea2ad-95eb-4afa-9d58-4347115b5e4e" released by "delete_volume" :: held 1.145s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Created reservations ['4e64a453-6272-4b21-bc14-e646234adf26'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:53 devstack cinder-volume[87389]: WARNING cinder.quota [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-981083379 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-981083379, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Created reservations ['ec81f7f3-3c52-42db-b4b5-3cb36864204e', 'bb3e0007-ff6a-44ce-80d8-634f1469bbbf', '3d7d4f69-117b-482f-b897-1715af6fd743', '37b72d60-96f4-453b-a9bd-bb56ccd65e63'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:53 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:04:53 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:53 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.404s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:53 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:04:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-854a7eb7-74d3-446f-a923-1c5a80c98bfc tempest-GroupSnapshotsV319Test-155292452 None] Delete group completed successfully. Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Flow 'volume_create_manager' (bdbd9695-ee7b-40e5-b13c-462db29dcfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b09faa-b0be-470e-95be-fa6baf505243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b09faa-b0be-470e-95be-fa6baf505243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1179077078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870ddb42-0b7b-415e-94ee-ca2855cc6f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b709c95a1a463eac1dc2da31a10685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:54Z,use_quota=True,user_id='5a74802e23ba4b05ac050cd4ca609f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4315250f-87c5-4066-bece-b0243009df68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4315250f-87c5-4066-bece-b0243009df68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d2e5f8-b789-4b4c-bd19-b9dfef1b86dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d2e5f8-b789-4b4c-bd19-b9dfef1b86dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '870ddb42-0b7b-415e-94ee-ca2855cc6f81', 'volume_name': 'volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bb42ad-61af-493e-854b-bd05a71e739d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bb42ad-61af-493e-854b-bd05a71e739d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4278cf86-0855-4903-99e5-37f48753b985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:54 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Volume 870ddb42-0b7b-415e-94ee-ca2855cc6f81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81', 'volume_size': 1} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1179077078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=870ddb42-0b7b-415e-94ee-ca2855cc6f81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b709c95a1a463eac1dc2da31a10685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:04:54Z,use_quota=True,user_id='5a74802e23ba4b05ac050cd4ca609f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Creating volume 870ddb42-0b7b-415e-94ee-ca2855cc6f81 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:04:54 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:54 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81 1073741824 Sep 01 02:04:54 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:54 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81 1073741824" returned: 0 in 0.645s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:04:55 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81 Sep 01 02:04:55 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:04:55 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Sep 01 02:04:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81" returned: 0 in 0.344s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:04:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:04:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4278cf86-0855-4903-99e5-37f48753b985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7e30b5-5de6-497e-bdab-e523531d1e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:04:55 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Volume volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81 (870ddb42-0b7b-415e-94ee-ca2855cc6f81): created successfully Sep 01 02:04:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7e30b5-5de6-497e-bdab-e523531d1e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:04:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Flow 'volume_create_manager' (bdbd9695-ee7b-40e5-b13c-462db29dcfb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:04:55 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-730737d8-4c0f-4f29-8c72-0191e21fbbc2 tempest-AttachVolumeNegativeTest-1397741062 None] Created volume successfully. Sep 01 02:04:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-8508a706-3536-478a-8619-84d775694f65 req-1ac834e9-05e0-4e6d-8a0d-a6809e2f5fa3 tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:04:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-8508a706-3536-478a-8619-84d775694f65 req-1ac834e9-05e0-4e6d-8a0d-a6809e2f5fa3 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:04:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-8508a706-3536-478a-8619-84d775694f65 req-1ac834e9-05e0-4e6d-8a0d-a6809e2f5fa3 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:04:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-8508a706-3536-478a-8619-84d775694f65 req-1ac834e9-05e0-4e6d-8a0d-a6809e2f5fa3 tempest-AttachVolumeNegativeTest-1397741062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '78b0c160-129b-441a-afdb-d59ba40fea24', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:04:57 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-8508a706-3536-478a-8619-84d775694f65 req-1ac834e9-05e0-4e6d-8a0d-a6809e2f5fa3 tempest-AttachVolumeNegativeTest-1397741062 None] attachment_update completed successfully. Sep 01 02:05:06 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2013a879-97a0-430b-811b-69f55274c51e tempest-GroupsV320Test-403809569 None] Group tempest-GroupsV320Test-Group-915413822: creating Sep 01 02:05:06 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2013a879-97a0-430b-811b-69f55274c51e tempest-GroupsV320Test-403809569 None] Group tempest-GroupsV320Test-Group-915413822: created successfully Sep 01 02:05:06 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2013a879-97a0-430b-811b-69f55274c51e tempest-GroupsV320Test-403809569 None] Create group completed successfully. Sep 01 02:05:08 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-f0786bfc-fbf4-4110-9029-849624bf7605 tempest-GroupsV320Test-403809569 None] Created reservations ['e320fc7c-b529-41d4-85c7-cee461f5ab22'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f0786bfc-fbf4-4110-9029-849624bf7605 tempest-GroupsV320Test-403809569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f0786bfc-fbf4-4110-9029-849624bf7605 tempest-GroupsV320Test-403809569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f0786bfc-fbf4-4110-9029-849624bf7605 tempest-GroupsV320Test-403809569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f0786bfc-fbf4-4110-9029-849624bf7605 tempest-GroupsV320Test-403809569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f0786bfc-fbf4-4110-9029-849624bf7605 tempest-GroupsV320Test-403809569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f0786bfc-fbf4-4110-9029-849624bf7605 tempest-GroupsV320Test-403809569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:08 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:05:08 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f0786bfc-fbf4-4110-9029-849624bf7605 tempest-GroupsV320Test-403809569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.666s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:09 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:09 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-f0786bfc-fbf4-4110-9029-849624bf7605 tempest-GroupsV320Test-403809569 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:09 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f0786bfc-fbf4-4110-9029-849624bf7605 tempest-GroupsV320Test-403809569 None] Delete group completed successfully. Sep 01 02:05:17 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-49f01f7f-6860-441f-908f-bf480e0c0e3f req-bf16c70f-b0cd-4997-8267-194fed760837 tempest-ServerActionsTestOtherA-874258025 None] Terminate volume connection completed successfully. Sep 01 02:05:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49f01f7f-6860-441f-908f-bf480e0c0e3f req-bf16c70f-b0cd-4997-8267-194fed760837 tempest-ServerActionsTestOtherA-874258025 None] Deleting attachment c5353db0-1652-4eb1-bbd9-bcf9549a5c93. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-49f01f7f-6860-441f-908f-bf480e0c0e3f req-8ebd467f-7ea5-4bde-bef5-7718c9b6869e tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-49f01f7f-6860-441f-908f-bf480e0c0e3f req-8ebd467f-7ea5-4bde-bef5-7718c9b6869e tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-49f01f7f-6860-441f-908f-bf480e0c0e3f req-8ebd467f-7ea5-4bde-bef5-7718c9b6869e tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49f01f7f-6860-441f-908f-bf480e0c0e3f req-8ebd467f-7ea5-4bde-bef5-7718c9b6869e tempest-ServerActionsTestOtherA-874258025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-a1a0f57f-fcee-4c70-b171-863727c5241a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '51cd32f5-deff-40c4-8def-64b548906a3f', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:05:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-49f01f7f-6860-441f-908f-bf480e0c0e3f req-8ebd467f-7ea5-4bde-bef5-7718c9b6869e tempest-ServerActionsTestOtherA-874258025 None] attachment_update completed successfully. Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Flow 'volume_create_manager' (65d44f0a-29d2-4e21-8ab3-5f122fc9260f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e432436d-ee7d-42ec-9020-c387f7221b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e432436d-ee7d-42ec-9020-c387f7221b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1486654779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1959c926-0421-4888-8a83-cbde626ad904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2e34deb0904f45a9edc9c022fa1160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:25Z,use_quota=True,user_id='780c7131aaf94b7fa271e9082b8cb4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07954a7b-506b-4146-be44-3cf1a8191806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07954a7b-506b-4146-be44-3cf1a8191806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f103652-aac8-4227-8438-61bfe547b786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f103652-aac8-4227-8438-61bfe547b786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1959c926-0421-4888-8a83-cbde626ad904', 'volume_name': 'volume-1959c926-0421-4888-8a83-cbde626ad904', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a41dae-9d77-43b2-921b-7589949d1c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3a41dae-9d77-43b2-921b-7589949d1c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516ca039-e9b5-4702-9e7c-01a8e522cc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:24 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Volume 1959c926-0421-4888-8a83-cbde626ad904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1959c926-0421-4888-8a83-cbde626ad904', 'volume_size': 1} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1486654779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1959c926-0421-4888-8a83-cbde626ad904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2e34deb0904f45a9edc9c022fa1160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:25Z,use_quota=True,user_id='780c7131aaf94b7fa271e9082b8cb4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Creating volume 1959c926-0421-4888-8a83-cbde626ad904 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:24 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:05:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:25 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904 1073741824 Sep 01 02:05:25 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:26 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904 1073741824" returned: 0 in 1.165s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:26 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904 Sep 01 02:05:26 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:26 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904" returned: 0 in 0.657s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (516ca039-e9b5-4702-9e7c-01a8e522cc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1959c926-0421-4888-8a83-cbde626ad904', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f64a62-cf7b-405a-8de1-4f77ebf86838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:27 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Volume volume-1959c926-0421-4888-8a83-cbde626ad904 (1959c926-0421-4888-8a83-cbde626ad904): created successfully Sep 01 02:05:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f64a62-cf7b-405a-8de1-4f77ebf86838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Flow 'volume_create_manager' (65d44f0a-29d2-4e21-8ab3-5f122fc9260f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:27 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-aa69a55a-5ef4-4f4c-ad0e-6478d5adf39f tempest-VolumeQuotasAdminTestJSON-2126263736 None] Created volume successfully. Sep 01 02:05:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Acquiring lock "cinder-1959c926-0421-4888-8a83-cbde626ad904-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "cinder-1959c926-0421-4888-8a83-cbde626ad904-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Acquiring lock "cinder-quobyte-1959c926-0421-4888-8a83-cbde626ad904" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "cinder-quobyte-1959c926-0421-4888-8a83-cbde626ad904" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:28 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[be06b56c-c052-45d4-8d00-9146c0c63d02]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:28 devstack sudo[91737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904 Sep 01 02:05:28 devstack sudo[91737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:29 devstack sudo[91737]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904" returned: 0 in 0.807s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:29 devstack sudo[91742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904 Sep 01 02:05:29 devstack sudo[91742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:29 devstack sudo[91742]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1959c926-0421-4888-8a83-cbde626ad904" returned: 0 in 0.559s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "cinder-quobyte-1959c926-0421-4888-8a83-cbde626ad904" released by "delete_volume" :: held 1.467s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:29 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Created reservations ['cf4d16ae-6932-4199-bfa9-b1affafe6c55', '24e42655-808d-4de9-8ed9-95492b9b770f', '04579a47-4442-41d7-b45b-d0ccf1a4dccb', 'b7b77b75-6834-4632-903d-f1997033d281'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:30 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:05:30 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:30 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.708s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:30 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:30 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Deleted volume successfully. Sep 01 02:05:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9414f3a9-1073-42ff-8dee-7732926c6cc5 tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "cinder-1959c926-0421-4888-8a83-cbde626ad904-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Flow 'volume_create_manager' (245f902e-3964-410d-909e-45d6d5e95772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e840bd-dd33-4697-a0fd-1616dce9ac30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71e840bd-dd33-4697-a0fd-1616dce9ac30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-241563194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194f87e6-aade-457f-ba4f-e8180dffa265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2e34deb0904f45a9edc9c022fa1160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:32Z,use_quota=True,user_id='780c7131aaf94b7fa271e9082b8cb4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83578584-1fce-4699-aff3-f27e28e81443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83578584-1fce-4699-aff3-f27e28e81443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8064cb-8e22-494d-a5f8-16d4293095a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d8064cb-8e22-494d-a5f8-16d4293095a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194f87e6-aade-457f-ba4f-e8180dffa265', 'volume_name': 'volume-194f87e6-aade-457f-ba4f-e8180dffa265', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b085e4b2-66c5-40e7-90fc-2bfd5a1e0a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b085e4b2-66c5-40e7-90fc-2bfd5a1e0a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7aa36aa-367f-4e8a-9532-6f917295c492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:32 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Volume 194f87e6-aade-457f-ba4f-e8180dffa265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194f87e6-aade-457f-ba4f-e8180dffa265', 'volume_size': 1} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-241563194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194f87e6-aade-457f-ba4f-e8180dffa265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2e34deb0904f45a9edc9c022fa1160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:32Z,use_quota=True,user_id='780c7131aaf94b7fa271e9082b8cb4ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Creating volume 194f87e6-aade-457f-ba4f-e8180dffa265 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:32 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:05:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:32 devstack sudo[91786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265 1073741824 Sep 01 02:05:32 devstack sudo[91786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:33 devstack sudo[91786]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265 1073741824" returned: 0 in 1.150s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:33 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265 Sep 01 02:05:33 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:33 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265" returned: 0 in 0.333s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7aa36aa-367f-4e8a-9532-6f917295c492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194f87e6-aade-457f-ba4f-e8180dffa265', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865c1940-cf92-4138-a0a4-35cbbf214ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:34 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Volume volume-194f87e6-aade-457f-ba4f-e8180dffa265 (194f87e6-aade-457f-ba4f-e8180dffa265): created successfully Sep 01 02:05:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865c1940-cf92-4138-a0a4-35cbbf214ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Flow 'volume_create_manager' (245f902e-3964-410d-909e-45d6d5e95772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:34 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e1aa9a8e-a025-4557-90a1-8725aa36ed7e tempest-VolumeQuotasAdminTestJSON-2126263736 None] Created volume successfully. Sep 01 02:05:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-6a0df58f-3b39-4034-8f6b-4b333fb87a3f req-7db5b9ce-604f-4a81-b297-673acaabce6e tempest-TaggedAttachmentsTest-1886990824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-6a0df58f-3b39-4034-8f6b-4b333fb87a3f req-7db5b9ce-604f-4a81-b297-673acaabce6e tempest-TaggedAttachmentsTest-1886990824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-6a0df58f-3b39-4034-8f6b-4b333fb87a3f req-7db5b9ce-604f-4a81-b297-673acaabce6e tempest-TaggedAttachmentsTest-1886990824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-6a0df58f-3b39-4034-8f6b-4b333fb87a3f req-7db5b9ce-604f-4a81-b297-673acaabce6e tempest-TaggedAttachmentsTest-1886990824 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-8569e3ef-958e-43e5-a0a8-ad87982677aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfeb1abf-bd2f-4c05-ab53-2d4906165aee', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:05:35 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-6a0df58f-3b39-4034-8f6b-4b333fb87a3f req-7db5b9ce-604f-4a81-b297-673acaabce6e tempest-TaggedAttachmentsTest-1886990824 None] attachment_update completed successfully. Sep 01 02:05:35 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fd3ba74e-150e-417c-985a-55850c9697fb tempest-VolumeQuotasAdminTestJSON-2071771593 None] Transfer volume completed successfully. Sep 01 02:05:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Acquiring lock "cinder-194f87e6-aade-457f-ba4f-e8180dffa265-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Lock "cinder-194f87e6-aade-457f-ba4f-e8180dffa265-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Acquiring lock "cinder-quobyte-194f87e6-aade-457f-ba4f-e8180dffa265" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Lock "cinder-quobyte-194f87e6-aade-457f-ba4f-e8180dffa265" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d39e145-d88d-47af-a723-4dc561a6fa25]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:36 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265 Sep 01 02:05:36 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:36 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265" returned: 0 in 0.359s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:36 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265 Sep 01 02:05:36 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:36 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-194f87e6-aade-457f-ba4f-e8180dffa265" returned: 0 in 0.265s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Lock "cinder-quobyte-194f87e6-aade-457f-ba4f-e8180dffa265" released by "delete_volume" :: held 0.667s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=82,cinder:UPDATE=54,cinder:INSERT=18,cinder:DELETE=3 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=62,cinder:SELECT=85,cinder:DELETE=4,cinder:INSERT=16 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Created reservations ['68a83651-f0ed-42fe-bc33-01f7326298f2', '3714426e-12e7-41ea-a20d-a550048f4abe', 'e653035a-f6ff-460f-949b-6637397e0cac', '5b4850a5-11c7-4a46-986e-9410e5ca5489'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:36 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:05:36 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:37 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.270s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:37 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:37 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Deleted volume successfully. Sep 01 02:05:37 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-167b9ac5-8811-497d-8dee-319ca6a43969 tempest-VolumeQuotasAdminTestJSON-1573037127 None] Lock "cinder-194f87e6-aade-457f-ba4f-e8180dffa265-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:38 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-b81015c2-30ae-4862-b64d-8efb1b3fcaaa req-fb24d0ea-6a08-414f-af8f-303a7e2b1f47 tempest-TaggedAttachmentsTest-1886990824 None] Terminate volume connection completed successfully. Sep 01 02:05:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-b81015c2-30ae-4862-b64d-8efb1b3fcaaa req-fb24d0ea-6a08-414f-af8f-303a7e2b1f47 tempest-TaggedAttachmentsTest-1886990824 None] Deleting attachment cfeb1abf-bd2f-4c05-ab53-2d4906165aee. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:47 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:05:47 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:47 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.423s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:05:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=5,cinder:SELECT=3 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Flow 'volume_create_manager' (147b3876-31e6-4bbe-aeff-87fd6b82efaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356593a3-924e-48d9-bc6f-7373201325ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356593a3-924e-48d9-bc6f-7373201325ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-731432965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4291538-0810-48f9-ab5c-30293d5b3763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3183f8b26ea949e69f542d34f9cdc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:48Z,use_quota=True,user_id='4867880617d048af8a96ee61bae18fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58454126-a988-4f2a-a609-c5344dff5e8c),volume_type_id=58454126-a988-4f2a-a609-c5344dff5e8c)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67aaba2b-1aa5-4957-a733-e275023f9c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67aaba2b-1aa5-4957-a733-e275023f9c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f99caa-48b0-4db0-b763-c458414db543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9f99caa-48b0-4db0-b763-c458414db543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4291538-0810-48f9-ab5c-30293d5b3763', 'volume_name': 'volume-f4291538-0810-48f9-ab5c-30293d5b3763', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f259148-abb3-4c43-9ed0-c008babb2e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f259148-abb3-4c43-9ed0-c008babb2e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9e0aae-01b0-47e7-9166-6fbf68984f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:48 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Volume f4291538-0810-48f9-ab5c-30293d5b3763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4291538-0810-48f9-ab5c-30293d5b3763', 'volume_size': 1} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:05:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-731432965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4291538-0810-48f9-ab5c-30293d5b3763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3183f8b26ea949e69f542d34f9cdc84e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:05:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:05:48Z,use_quota=True,user_id='4867880617d048af8a96ee61bae18fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58454126-a988-4f2a-a609-c5344dff5e8c),volume_type_id=58454126-a988-4f2a-a609-c5344dff5e8c)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Creating volume f4291538-0810-48f9-ab5c-30293d5b3763 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:05:48 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:05:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:48 devstack sudo[91992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763 1073741824 Sep 01 02:05:48 devstack sudo[91992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:49 devstack sudo[91992]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763 1073741824" returned: 0 in 0.794s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:49 devstack sudo[91999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763 Sep 01 02:05:49 devstack sudo[91999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:49 devstack sudo[91999]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763" returned: 0 in 0.256s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:05:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da9e0aae-01b0-47e7-9166-6fbf68984f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4291538-0810-48f9-ab5c-30293d5b3763', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d8b981-71f4-4ce8-b55c-cede9fa712b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:05:49 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Volume volume-f4291538-0810-48f9-ab5c-30293d5b3763 (f4291538-0810-48f9-ab5c-30293d5b3763): created successfully Sep 01 02:05:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d8b981-71f4-4ce8-b55c-cede9fa712b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:05:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Flow 'volume_create_manager' (147b3876-31e6-4bbe-aeff-87fd6b82efaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:05:49 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a3c0fa14-4b00-4efd-a3e9-1d249a1518eb tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Created volume successfully. Sep 01 02:05:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5db19ff3-bea7-423a-bf66-2a3f7142293b tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5db19ff3-bea7-423a-bf66-2a3f7142293b tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5db19ff3-bea7-423a-bf66-2a3f7142293b tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5db19ff3-bea7-423a-bf66-2a3f7142293b tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5db19ff3-bea7-423a-bf66-2a3f7142293b tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5db19ff3-bea7-423a-bf66-2a3f7142293b tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:50 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:05:50 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Acquiring lock "cinder-8569e3ef-958e-43e5-a0a8-ad87982677aa-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Lock "cinder-8569e3ef-958e-43e5-a0a8-ad87982677aa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Acquiring lock "cinder-quobyte-8569e3ef-958e-43e5-a0a8-ad87982677aa" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Lock "cinder-quobyte-8569e3ef-958e-43e5-a0a8-ad87982677aa" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae108a8e-a71e-40bf-a752-07b06cf69062]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:51 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5db19ff3-bea7-423a-bf66-2a3f7142293b tempest-VolumeRetypeWithoutMigrationTest-537753068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.270s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-5db19ff3-bea7-423a-bf66-2a3f7142293b tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5db19ff3-bea7-423a-bf66-2a3f7142293b tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Retype volume completed successfully. Sep 01 02:05:51 devstack sudo[92006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa Sep 01 02:05:51 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:51 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa" returned: 0 in 0.369s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:51 devstack sudo[92011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa Sep 01 02:05:51 devstack sudo[92011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:51 devstack sudo[92011]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8569e3ef-958e-43e5-a0a8-ad87982677aa" returned: 0 in 0.294s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Lock "cinder-quobyte-8569e3ef-958e-43e5-a0a8-ad87982677aa" released by "delete_volume" :: held 0.712s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Created reservations ['beb84e2f-cf02-4afb-82f0-ce0fbb184e99', '3d2b84bc-2211-43d4-b997-25b1fcf4a461', '0032e6de-9e04-4eea-b38c-71e7b4e15bfd', 'd0918eff-51d8-4454-81c3-8d9807ba53dd'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:51 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:05:51 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:52 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-aacc3e11-7c32-42fe-a3a2-a3dc4599d2e7 req-602f3e6d-fbd8-442a-8740-899fafb81833 tempest-AttachVolumeNegativeTest-1397741062 None] Terminate volume connection completed successfully. Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-aacc3e11-7c32-42fe-a3a2-a3dc4599d2e7 req-602f3e6d-fbd8-442a-8740-899fafb81833 tempest-AttachVolumeNegativeTest-1397741062 None] Deleting attachment 78b0c160-129b-441a-afdb-d59ba40fea24. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Acquiring lock "cinder-f4291538-0810-48f9-ab5c-30293d5b3763-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "cinder-f4291538-0810-48f9-ab5c-30293d5b3763-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Acquiring lock "cinder-quobyte-f4291538-0810-48f9-ab5c-30293d5b3763" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "cinder-quobyte-f4291538-0810-48f9-ab5c-30293d5b3763" acquired by "delete_volume" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef12d990-436c-4511-aec5-51e66eb5b036]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:52 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.312s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:52 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Deleted volume successfully. Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3efbdd41-216c-4321-8952-2dafd043b33f tempest-TaggedAttachmentsTest-1886990824 None] Lock "cinder-8569e3ef-958e-43e5-a0a8-ad87982677aa-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:52 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763 Sep 01 02:05:52 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:52 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763" returned: 0 in 0.435s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:52 devstack sudo[92025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763 Sep 01 02:05:52 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:52 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f4291538-0810-48f9-ab5c-30293d5b3763" returned: 0 in 0.295s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "cinder-quobyte-f4291538-0810-48f9-ab5c-30293d5b3763" released by "delete_volume" :: held 0.789s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:05:53 devstack cinder-volume[87389]: WARNING cinder.quota [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:05:53 devstack cinder-volume[87389]: WARNING cinder.quota [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:05:53 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Created reservations ['5e847935-9970-47ab-a965-71518f6d858f', '51b4213a-098b-4f05-ad69-1e90e7e97374', '287e4cdc-0edf-421d-88e6-cc341f4fbaea', 'e2f490ab-452a-4ba2-a0f5-1eefdd70dba9'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:05:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:05:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:05:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:05:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:05:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:05:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:05:53 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:05:53 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:05:53 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Sep 01 02:05:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.607s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:05:53 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:05:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Deleted volume successfully. Sep 01 02:05:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d8458f25-b654-467b-92b4-f8e099675289 tempest-VolumeRetypeWithoutMigrationTest-537753068 None] Lock "cinder-f4291538-0810-48f9-ab5c-30293d5b3763-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Flow 'volume_create_manager' (74f3367d-e83a-4d91-89bc-1237a70a32fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc88a4ac-d473-4819-acc4-b2dacd0c89cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc88a4ac-d473-4819-acc4-b2dacd0c89cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-728639896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3631a0-5804-489c-a8e0-a294b629bd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7c64d0495e4557bb96c171228da04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:01Z,use_quota=True,user_id='f7f572484adf4e22882210a8f85caed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e46e38-4ec7-4f33-97b3-f1766597ced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e46e38-4ec7-4f33-97b3-f1766597ced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee15b8c2-cab5-4225-b48e-ea1437ba2838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee15b8c2-cab5-4225-b48e-ea1437ba2838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc3631a0-5804-489c-a8e0-a294b629bd64', 'volume_name': 'volume-dc3631a0-5804-489c-a8e0-a294b629bd64', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2228ac32-9416-4678-a1a8-06b32e12f339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2228ac32-9416-4678-a1a8-06b32e12f339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b915382-8ae7-4f6d-828e-5c9094e2d1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:01 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Volume dc3631a0-5804-489c-a8e0-a294b629bd64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc3631a0-5804-489c-a8e0-a294b629bd64', 'volume_size': 1} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-728639896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc3631a0-5804-489c-a8e0-a294b629bd64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d7c64d0495e4557bb96c171228da04a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:01Z,use_quota=True,user_id='f7f572484adf4e22882210a8f85caed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Creating volume dc3631a0-5804-489c-a8e0-a294b629bd64 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:01 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:01 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 1073741824 Sep 01 02:06:01 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:01 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 1073741824" returned: 0 in 0.484s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:01 devstack sudo[92077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 Sep 01 02:06:01 devstack sudo[92077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:02 devstack sudo[92077]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64" returned: 0 in 0.328s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b915382-8ae7-4f6d-828e-5c9094e2d1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc3631a0-5804-489c-a8e0-a294b629bd64', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a0146b-cfc8-4100-bf2c-b256b784c43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:02 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Volume volume-dc3631a0-5804-489c-a8e0-a294b629bd64 (dc3631a0-5804-489c-a8e0-a294b629bd64): created successfully Sep 01 02:06:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a0146b-cfc8-4100-bf2c-b256b784c43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Flow 'volume_create_manager' (74f3367d-e83a-4d91-89bc-1237a70a32fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:02 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a453e56a-ba47-495d-b118-96a3eb8c0c07 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Created volume successfully. Sep 01 02:06:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Creating offline snapshot 9d498629-9769-46a7-959e-22131f858a23 of volume dc3631a0-5804-489c-a8e0-a294b629bd64 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:06:03 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fca932-30d9-4543-8904-afcd7d31bf0b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:04 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 Sep 01 02:06:04 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:04 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64" returned: 0 in 0.478s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:04 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 1G Sep 01 02:06:04 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:05 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 1G" returned: 0 in 0.619s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc3631a0-5804-489c-a8e0-a294b629bd64 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:05 devstack sudo[92114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc3631a0-5804-489c-a8e0-a294b629bd64 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 Sep 01 02:06:05 devstack sudo[92114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:05 devstack sudo[92114]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc3631a0-5804-489c-a8e0-a294b629bd64 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23" returned: 0 in 0.339s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:05 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 is being set with open permissions: ugo+rw Sep 01 02:06:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:05 devstack sudo[92119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 Sep 01 02:06:05 devstack sudo[92119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:05 devstack sudo[92119]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23" returned: 0 in 0.291s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:05 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.info Sep 01 02:06:05 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:06 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.info" returned: 0 in 0.353s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:06 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.info is being set with open permissions: ugo+rw Sep 01 02:06:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:06 devstack sudo[92126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.info Sep 01 02:06:06 devstack sudo[92126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:06 devstack sudo[92126]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.info" returned: 0 in 0.318s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.516s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:06 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-77ff7059-5de5-4ec2-b5c3-8c87ebcd12aa tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Create snapshot completed successfully Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Acquiring lock "cinder-9d498629-9769-46a7-959e-22131f858a23-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "cinder-9d498629-9769-46a7-959e-22131f858a23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Acquiring lock "cinder-quobyte-dc3631a0-5804-489c-a8e0-a294b629bd64" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "cinder-quobyte-dc3631a0-5804-489c-a8e0-a294b629bd64" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Acquiring lock "cinder-quobyte-9d498629-9769-46a7-959e-22131f858a23" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "cinder-quobyte-9d498629-9769-46a7-959e-22131f858a23" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Deleting offline snapshot 9d498629-9769-46a7-959e-22131f858a23 of volume dc3631a0-5804-489c-a8e0-a294b629bd64 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] snapshot_file for this snap is: volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9091773b-1af3-4cbb-95fd-b62e343dbb3b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:08 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 Sep 01 02:06:08 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:08 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23" returned: 0 in 0.615s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc3631a0-5804-489c-a8e0-a294b629bd64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[769c49c0-e219-42a5-95ad-191e5645e175]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:09 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 Sep 01 02:06:09 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:09 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64" returned: 0 in 0.799s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:09 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 Sep 01 02:06:09 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:10 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23" returned: 0 in 0.720s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:10 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23 Sep 01 02:06:10 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:10 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64.9d498629-9769-46a7-959e-22131f858a23" returned: 0 in 0.421s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "cinder-quobyte-9d498629-9769-46a7-959e-22131f858a23" released by "_delete_snapshot" :: held 2.776s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "cinder-quobyte-dc3631a0-5804-489c-a8e0-a294b629bd64" released by "delete_snapshot" :: held 2.809s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:10 devstack cinder-volume[87389]: WARNING cinder.quota [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:10 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Created reservations ['1ca4a253-17f7-46e9-8f88-3a20672a16cd', '81f29490-18ad-45d7-9641-f1abfdd691b3', '7a1c4d35-db48-4929-bb71-583021b4cd55', 'd4d0aba5-e950-406c-b46d-e3e8061e79d0'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:11 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Delete snapshot completed successfully. Sep 01 02:06:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f63f1799-387d-477b-8d6d-bbffdf15431c tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "cinder-9d498629-9769-46a7-959e-22131f858a23-delete_snapshot" released by "delete_snapshot" :: held 3.054s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Acquiring lock "cinder-dc3631a0-5804-489c-a8e0-a294b629bd64-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "cinder-dc3631a0-5804-489c-a8e0-a294b629bd64-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Acquiring lock "cinder-quobyte-dc3631a0-5804-489c-a8e0-a294b629bd64" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "cinder-quobyte-dc3631a0-5804-489c-a8e0-a294b629bd64" acquired by "delete_volume" :: waited 0.046s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:11 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed8575e-7774-4eff-a2f5-8491e106a17f]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:11 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 Sep 01 02:06:11 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:12 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64" returned: 0 in 0.555s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:12 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64 Sep 01 02:06:12 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:12 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-d28c2850-a73d-419e-9079-c33fca00977b tempest-ServerActionsTestOtherA-874258025 None] Terminate volume connection completed successfully. Sep 01 02:06:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-d28c2850-a73d-419e-9079-c33fca00977b tempest-ServerActionsTestOtherA-874258025 None] Deleting attachment 51cd32f5-deff-40c4-8def-64b548906a3f. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:06:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "cinder-a1a0f57f-fcee-4c70-b171-863727c5241a-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:12 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-dc3631a0-5804-489c-a8e0-a294b629bd64" returned: 0 in 0.361s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "cinder-quobyte-dc3631a0-5804-489c-a8e0-a294b629bd64" released by "delete_volume" :: held 1.081s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Lock "cinder-a1a0f57f-fcee-4c70-b171-863727c5241a-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "cinder-quobyte-a1a0f57f-fcee-4c70-b171-863727c5241a" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Lock "cinder-quobyte-a1a0f57f-fcee-4c70-b171-863727c5241a" acquired by "delete_volume" :: waited 0.044s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:12 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Created reservations ['e511d2db-da76-4d3a-b9c9-fd838e53ef93', '79a8eec3-dbfc-45d5-bd6b-d027f2140c1d', '6ebb3bea-9e22-4b4e-84de-3bce293b4143', '926890e9-0671-4570-8573-dec4219ac025'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:12 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b481e6e-4bbc-43f5-919b-cdce269a6fc6]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:13 devstack sudo[92253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a Sep 01 02:06:13 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:06:13 devstack sudo[92253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:13 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:13 devstack sudo[92253]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a" returned: 0 in 0.705s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:13 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.570s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:13 devstack sudo[92268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a Sep 01 02:06:13 devstack sudo[92268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:13 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Deleted volume successfully. Sep 01 02:06:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1877cbc0-f75d-4955-964e-331ac027c401 tempest-VolumeSnapshotQuotasNegativeTestJSON-2039535061 None] Lock "cinder-dc3631a0-5804-489c-a8e0-a294b629bd64-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:14 devstack sudo[92268]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1a0f57f-fcee-4c70-b171-863727c5241a" returned: 0 in 0.585s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Lock "cinder-quobyte-a1a0f57f-fcee-4c70-b171-863727c5241a" released by "delete_volume" :: held 1.355s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:14 devstack cinder-volume[87389]: DEBUG cinder.quota [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Created reservations ['954b3d91-39c2-4847-b19d-09b8f0b05863', 'ef47f120-3d07-43d2-a416-107f50e16a85', '2d369387-b68e-4b99-95b5-6c9bd75088e6', '2c7a7297-04ee-4be1-96f9-6bcfb9c682df'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:14 devstack sudo[92272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:06:14 devstack sudo[92272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:15 devstack sudo[92272]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.438s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:15 devstack cinder-volume[87389]: DEBUG cinder.manager [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:15 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Deleted volume successfully. Sep 01 02:06:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-706ff2df-ac4a-48c4-ba49-f6534b802e2b req-5b3c1b22-2455-4a82-9f7b-e07d79a3a538 tempest-ServerActionsTestOtherA-874258025 None] Lock "cinder-a1a0f57f-fcee-4c70-b171-863727c5241a-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "cinder-306836ae-8cb6-4d34-bf42-220390934b9a-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Lock "cinder-306836ae-8cb6-4d34-bf42-220390934b9a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "cinder-quobyte-306836ae-8cb6-4d34-bf42-220390934b9a" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Lock "cinder-quobyte-306836ae-8cb6-4d34-bf42-220390934b9a" acquired by "delete_volume" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:16 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d07528c-d0dc-4b43-94f1-a18024040755]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:16 devstack sudo[92277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a Sep 01 02:06:16 devstack sudo[92277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:17 devstack sudo[92277]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a" returned: 0 in 0.506s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:17 devstack sudo[92282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a Sep 01 02:06:17 devstack sudo[92282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:17 devstack sudo[92282]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-306836ae-8cb6-4d34-bf42-220390934b9a" returned: 0 in 0.450s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Lock "cinder-quobyte-306836ae-8cb6-4d34-bf42-220390934b9a" released by "delete_volume" :: held 1.014s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:17 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Created reservations ['2cfdf303-cb9a-40d0-b3cf-dafbd3fb248e', '7d32cb21-8b12-4fac-becf-b23b51e46c3d', '64064896-b4c6-4677-8ee8-d10c180186d7', '8db1a28f-3fe0-4150-a493-2c88f6095c17'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:17 devstack sudo[92285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:06:17 devstack sudo[92285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:18 devstack sudo[92285]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.327s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:18 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:18 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Deleted volume successfully. Sep 01 02:06:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e8b21414-0565-462e-a429-b380d67c68d9 tempest-ServerActionsTestOtherA-874258025 None] Lock "cinder-306836ae-8cb6-4d34-bf42-220390934b9a-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Flow 'volume_create_manager' (62c568dc-f1a5-4b6f-b1ef-3e4ad81a7cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350e3b51-836e-474a-af82-b5bc3ab0fe3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350e3b51-836e-474a-af82-b5bc3ab0fe3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1808447975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aec4df0-d622-4f7f-a0a9-344b7ca2a189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c461a978658143439a253a873df21aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:25Z,use_quota=True,user_id='2407b5a15c2247d7aa178a07b23a0f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f54ad9c-a61f-45ba-9eae-f8a3aeb2ccfe),volume_type_id=5f54ad9c-a61f-45ba-9eae-f8a3aeb2ccfe)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce36953c-6cbd-4c45-8992-85a053221399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce36953c-6cbd-4c45-8992-85a053221399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ce1b10-7bea-4967-a3e5-40a1040f0d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ce1b10-7bea-4967-a3e5-40a1040f0d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aec4df0-d622-4f7f-a0a9-344b7ca2a189', 'volume_name': 'volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e39042-0037-4fd5-b732-e520dc9e6398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e39042-0037-4fd5-b732-e520dc9e6398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b549b37e-7c11-4870-aac3-dc2619f488fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:25 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Volume 6aec4df0-d622-4f7f-a0a9-344b7ca2a189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189', 'volume_size': 1} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1808447975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aec4df0-d622-4f7f-a0a9-344b7ca2a189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c461a978658143439a253a873df21aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:25Z,use_quota=True,user_id='2407b5a15c2247d7aa178a07b23a0f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f54ad9c-a61f-45ba-9eae-f8a3aeb2ccfe),volume_type_id=5f54ad9c-a61f-45ba-9eae-f8a3aeb2ccfe)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Creating volume 6aec4df0-d622-4f7f-a0a9-344b7ca2a189 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:25 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:06:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:25 devstack sudo[92377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189 1073741824 Sep 01 02:06:25 devstack sudo[92377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:26 devstack sudo[92377]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189 1073741824" returned: 0 in 0.603s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:26 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189 Sep 01 02:06:26 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:26 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189" returned: 0 in 0.406s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b549b37e-7c11-4870-aac3-dc2619f488fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af91b41-4eca-47df-a75d-e8857c5516b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:26 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Volume volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189 (6aec4df0-d622-4f7f-a0a9-344b7ca2a189): created successfully Sep 01 02:06:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af91b41-4eca-47df-a75d-e8857c5516b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Flow 'volume_create_manager' (62c568dc-f1a5-4b6f-b1ef-3e4ad81a7cb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:26 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-13899e7c-eaec-48e1-a1ea-549c0949ed76 tempest-VolumeTypesAccessTest-1277064898 None] Created volume successfully. Sep 01 02:06:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Acquiring lock "cinder-6aec4df0-d622-4f7f-a0a9-344b7ca2a189-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Lock "cinder-6aec4df0-d622-4f7f-a0a9-344b7ca2a189-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Acquiring lock "cinder-quobyte-6aec4df0-d622-4f7f-a0a9-344b7ca2a189" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Lock "cinder-quobyte-6aec4df0-d622-4f7f-a0a9-344b7ca2a189" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:27 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[660266a3-474c-44db-a870-bc847470c0fa]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:27 devstack sudo[92405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189 Sep 01 02:06:27 devstack sudo[92405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:28 devstack sudo[92405]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189" returned: 0 in 0.437s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:28 devstack sudo[92410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189 Sep 01 02:06:28 devstack sudo[92410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:28 devstack sudo[92410]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6aec4df0-d622-4f7f-a0a9-344b7ca2a189" returned: 0 in 0.269s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Lock "cinder-quobyte-6aec4df0-d622-4f7f-a0a9-344b7ca2a189" released by "delete_volume" :: held 0.760s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:28 devstack cinder-volume[87389]: WARNING cinder.quota [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1011387691 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1011387691, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:28 devstack cinder-volume[87389]: WARNING cinder.quota [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1011387691 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1011387691, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Created reservations ['8ec81004-d915-49b3-88cc-af39280b6c10', '6aa8c408-0b81-4e33-8b74-dc67fc6bacb5', '52521700-f695-4f61-945b-904365a7f7b9', '77647063-11f2-4599-9103-c5f92a635ea2'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:28 devstack sudo[92414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:06:28 devstack sudo[92414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:28 devstack sudo[92414]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.354s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:28 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Deleted volume successfully. Sep 01 02:06:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3e223a8-beee-4dee-b404-77287df2e618 tempest-VolumeTypesAccessTest-1277064898 None] Lock "cinder-6aec4df0-d622-4f7f-a0a9-344b7ca2a189-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:35 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Flow 'volume_create_manager' (b80ffb56-4def-4dc5-ad45-af0f472990b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68239e9-4065-4683-abe8-9827b3abc9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68239e9-4065-4683-abe8-9827b3abc9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1476799468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe42079d-5778-4258-a560-b1481db3b04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b709c95a1a463eac1dc2da31a10685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:36Z,use_quota=True,user_id='5a74802e23ba4b05ac050cd4ca609f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae46b6ed-2bc1-4a0c-9ef7-e00544ab6cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae46b6ed-2bc1-4a0c-9ef7-e00544ab6cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0eb647-82be-4141-ac16-e2c0ab5d33de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d0eb647-82be-4141-ac16-e2c0ab5d33de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe42079d-5778-4258-a560-b1481db3b04f', 'volume_name': 'volume-fe42079d-5778-4258-a560-b1481db3b04f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e2e79d-e54a-4aba-ab08-17afcc8a8993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e2e79d-e54a-4aba-ab08-17afcc8a8993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f76dbc1-1cd0-4f69-8b3c-2dbab3e5c495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:36 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Volume fe42079d-5778-4258-a560-b1481db3b04f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe42079d-5778-4258-a560-b1481db3b04f', 'volume_size': 1} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1476799468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe42079d-5778-4258-a560-b1481db3b04f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b709c95a1a463eac1dc2da31a10685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:36Z,use_quota=True,user_id='5a74802e23ba4b05ac050cd4ca609f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Creating volume fe42079d-5778-4258-a560-b1481db3b04f {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:36 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:36 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f 1073741824 Sep 01 02:06:36 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:36 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f 1073741824" returned: 0 in 0.663s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:36 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f Sep 01 02:06:36 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:37 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f" returned: 0 in 0.536s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f76dbc1-1cd0-4f69-8b3c-2dbab3e5c495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe42079d-5778-4258-a560-b1481db3b04f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd8761c-2578-47e1-ad94-9120c21f1836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:37 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Volume volume-fe42079d-5778-4258-a560-b1481db3b04f (fe42079d-5778-4258-a560-b1481db3b04f): created successfully Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd8761c-2578-47e1-ad94-9120c21f1836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Flow 'volume_create_manager' (b80ffb56-4def-4dc5-ad45-af0f472990b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:37 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-75b6dc48-82fc-4118-99be-33b831e7ad5d tempest-AttachVolumeNegativeTest-1397741062 None] Created volume successfully. Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Flow 'volume_create_manager' (61ee92cd-3fc2-428d-8183-be513e3300ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c946f1-2eab-4219-9685-b5827c330502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c946f1-2eab-4219-9685-b5827c330502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1223668509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f46a5e1-8cae-4d58-abf0-ae06ed52141b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a1d2c2c880417bbe09b2417a19785d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:38Z,use_quota=True,user_id='23ec15b3b5ad4f18b80bfe660019d5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873f6a0f-c67e-48e2-ab65-63888cc564d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873f6a0f-c67e-48e2-ab65-63888cc564d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc1037d-0984-4d63-a499-8353f4716c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc1037d-0984-4d63-a499-8353f4716c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f46a5e1-8cae-4d58-abf0-ae06ed52141b', 'volume_name': 'volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733ecfd1-b576-4a3f-b653-5c715436621d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733ecfd1-b576-4a3f-b653-5c715436621d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d534a758-2058-4a3e-8ca4-fa50b41d9d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:37 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Volume 4f46a5e1-8cae-4d58-abf0-ae06ed52141b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b', 'volume_size': 1} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1223668509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f46a5e1-8cae-4d58-abf0-ae06ed52141b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a1d2c2c880417bbe09b2417a19785d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:38Z,use_quota=True,user_id='23ec15b3b5ad4f18b80bfe660019d5c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Creating volume 4f46a5e1-8cae-4d58-abf0-ae06ed52141b {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:37 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:06:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:37 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b 1073741824 Sep 01 02:06:37 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:38 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b 1073741824" returned: 0 in 0.828s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:38 devstack sudo[92512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b Sep 01 02:06:38 devstack sudo[92512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:39 devstack sudo[92512]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b" returned: 0 in 0.514s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.492s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d534a758-2058-4a3e-8ca4-fa50b41d9d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18742bed-c546-4b1c-9aa7-fb97bacea047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:39 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Volume volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b (4f46a5e1-8cae-4d58-abf0-ae06ed52141b): created successfully Sep 01 02:06:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18742bed-c546-4b1c-9aa7-fb97bacea047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Flow 'volume_create_manager' (61ee92cd-3fc2-428d-8183-be513e3300ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-49504269-b445-4116-86a8-3287bf9697b6 req-04f4176b-68fb-43a1-aecf-b3d8fd6d269c tempest-VolumesSnapshotsTestJSON-718212904 None] Created volume successfully. Sep 01 02:06:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-543c4ed1-9b62-409c-bbfe-1ddaf53bd36c req-8203d612-735a-442b-b1d9-848b91761c03 tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-543c4ed1-9b62-409c-bbfe-1ddaf53bd36c req-8203d612-735a-442b-b1d9-848b91761c03 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-543c4ed1-9b62-409c-bbfe-1ddaf53bd36c req-8203d612-735a-442b-b1d9-848b91761c03 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-543c4ed1-9b62-409c-bbfe-1ddaf53bd36c req-8203d612-735a-442b-b1d9-848b91761c03 tempest-AttachVolumeNegativeTest-1397741062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-fe42079d-5778-4258-a560-b1481db3b04f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '023b4fa8-b2c1-482d-a7c9-98d0757467f7', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:06:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-543c4ed1-9b62-409c-bbfe-1ddaf53bd36c req-8203d612-735a-442b-b1d9-848b91761c03 tempest-AttachVolumeNegativeTest-1397741062 None] attachment_update completed successfully. Sep 01 02:06:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] Creating offline snapshot 3a42e687-d68f-40af-8aca-50ed4067ba6f of volume 4f46a5e1-8cae-4d58-abf0-ae06ed52141b {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:06:41 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1aa2c59-539c-4fc8-bfa9-80f8bad9678c]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:41 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b Sep 01 02:06:41 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:42 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b" returned: 0 in 0.926s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:42 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f 1G Sep 01 02:06:42 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:42 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f 1G" returned: 0 in 0.867s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:43 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f Sep 01 02:06:43 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:43 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f" returned: 0 in 0.426s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:43 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f is being set with open permissions: ugo+rw Sep 01 02:06:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:43 devstack sudo[92941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f Sep 01 02:06:43 devstack sudo[92941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:43 devstack sudo[92941]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f" returned: 0 in 0.495s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:44 devstack sudo[92945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.info Sep 01 02:06:44 devstack sudo[92945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:44 devstack sudo[92945]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.info" returned: 0 in 0.535s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:44 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.info is being set with open permissions: ugo+rw Sep 01 02:06:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:44 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.info Sep 01 02:06:44 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.info" returned: 0 in 0.605s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:45 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.084s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:45 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-f35ff8a4-15b2-48ff-a957-de05b901f893 req-fa53e006-a51c-4469-bf5a-8602d09d9968 tempest-VolumesSnapshotsTestJSON-718212904 None] Create snapshot completed successfully Sep 01 02:06:46 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-63f98f8a-45c6-4b07-ba08-ecdbdd056f72 req-102f3f98-6e23-43f3-8bbb-bec6d25c4c9a tempest-AttachVolumeNegativeTest-1397741062 None] Terminate volume connection completed successfully. Sep 01 02:06:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-63f98f8a-45c6-4b07-ba08-ecdbdd056f72 req-102f3f98-6e23-43f3-8bbb-bec6d25c4c9a tempest-AttachVolumeNegativeTest-1397741062 None] Deleting attachment 023b4fa8-b2c1-482d-a7c9-98d0757467f7. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:06:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Acquiring lock "cinder-3a42e687-d68f-40af-8aca-50ed4067ba6f-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "cinder-3a42e687-d68f-40af-8aca-50ed4067ba6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.100s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Acquiring lock "cinder-quobyte-4f46a5e1-8cae-4d58-abf0-ae06ed52141b" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "cinder-quobyte-4f46a5e1-8cae-4d58-abf0-ae06ed52141b" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Acquiring lock "cinder-quobyte-3a42e687-d68f-40af-8aca-50ed4067ba6f" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "cinder-quobyte-3a42e687-d68f-40af-8aca-50ed4067ba6f" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Deleting offline snapshot 3a42e687-d68f-40af-8aca-50ed4067ba6f of volume 4f46a5e1-8cae-4d58-abf0-ae06ed52141b {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:06:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] snapshot_file for this snap is: volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:06:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a56b2bd-7268-4fd7-a58f-d036e363cfaa]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:47 devstack sudo[93066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f Sep 01 02:06:47 devstack sudo[93066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:47 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:06:47 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:47 devstack sudo[93066]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f" returned: 0 in 0.643s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[33742882-cd33-41cc-9a17-b865a5cccd26]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:47 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.478s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:06:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:06:47 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b Sep 01 02:06:47 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:48 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=68,cinder:INSERT=16,cinder:UPDATE=82,cinder:DELETE=8 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:06:48 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=71,cinder:UPDATE=74,cinder:DELETE=5,cinder:INSERT=19 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:06:48 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b" returned: 0 in 0.779s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:48 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f Sep 01 02:06:48 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:49 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f" returned: 0 in 1.054s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:49 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f Sep 01 02:06:49 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:49 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b.3a42e687-d68f-40af-8aca-50ed4067ba6f" returned: 0 in 0.548s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "cinder-quobyte-3a42e687-d68f-40af-8aca-50ed4067ba6f" released by "_delete_snapshot" :: held 3.269s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "cinder-quobyte-4f46a5e1-8cae-4d58-abf0-ae06ed52141b" released by "delete_snapshot" :: held 3.335s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:50 devstack cinder-volume[87389]: DEBUG cinder.quota [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Created reservations ['bd50342d-ff12-424a-a8d3-76a41ea3329b', '772cdff2-1ce7-40ab-863d-a2e801b49c70', '40c3d96c-2754-4ac5-8806-7d669c1e3e0c', '8b1cfb2b-401e-43e7-99ee-1971202df8b1'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:50 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Delete snapshot completed successfully. Sep 01 02:06:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-f61c9480-10c0-4122-b0ef-f5db9d0e9fef req-fdb5c649-998f-435a-bdf0-df57125caeb0 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "cinder-3a42e687-d68f-40af-8aca-50ed4067ba6f-delete_snapshot" released by "delete_snapshot" :: held 3.678s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Acquiring lock "cinder-4f46a5e1-8cae-4d58-abf0-ae06ed52141b-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "cinder-4f46a5e1-8cae-4d58-abf0-ae06ed52141b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Acquiring lock "cinder-quobyte-4f46a5e1-8cae-4d58-abf0-ae06ed52141b" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:06:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "cinder-quobyte-4f46a5e1-8cae-4d58-abf0-ae06ed52141b" acquired by "delete_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:06:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[463ba0ea-64cc-4b27-86a6-32a002e9ae2e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:06:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:51 devstack sudo[93137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b Sep 01 02:06:51 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:52 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b" returned: 0 in 0.770s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:52 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b Sep 01 02:06:52 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:52 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f46a5e1-8cae-4d58-abf0-ae06ed52141b" returned: 0 in 0.640s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "cinder-quobyte-4f46a5e1-8cae-4d58-abf0-ae06ed52141b" released by "delete_volume" :: held 1.545s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:53 devstack cinder-volume[87389]: DEBUG cinder.quota [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Created reservations ['421a8427-723a-43fa-abb3-f5d8fb514881', '28d61dd7-c0e5-49ec-b2cb-d01204463242', 'cddcc4ea-1b85-4620-b41e-7447701ff7ad', '6f56e2c2-b898-4e42-b2ca-a1a41b4b9041'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:06:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:53 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:06:53 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:53 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.329s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:53 devstack cinder-volume[87389]: DEBUG cinder.manager [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:06:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Deleted volume successfully. Sep 01 02:06:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-8763ba2f-cb29-4de7-aae0-34f81beabb91 req-268f9f3f-e639-4dcf-90dd-eb6cce20dce4 tempest-VolumesSnapshotsTestJSON-718212904 None] Lock "cinder-4f46a5e1-8cae-4d58-abf0-ae06ed52141b-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Flow 'volume_create_manager' (c3c24f5b-6f7d-4728-b1ac-1fd35da70fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee687f5e-5dab-44e2-98d4-11ba54597479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee687f5e-5dab-44e2-98d4-11ba54597479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1429380141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d66a2a-ebe4-48f2-8b8e-65c01cda678b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3499dece315344a48bb7bb5115005ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:57Z,use_quota=True,user_id='f9c6c13ce4ba4f3899bb37e7fc18e9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595ee7c6-a29d-44a3-9819-15429a798352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (595ee7c6-a29d-44a3-9819-15429a798352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7c9e16-d4be-4792-807a-0b66ae8f1c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7c9e16-d4be-4792-807a-0b66ae8f1c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90d66a2a-ebe4-48f2-8b8e-65c01cda678b', 'volume_name': 'volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18548ef-3932-4601-aadc-da8dc43b4e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18548ef-3932-4601-aadc-da8dc43b4e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3aa1fd-cf35-48ed-9833-33a670043c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:56 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Volume 90d66a2a-ebe4-48f2-8b8e-65c01cda678b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b', 'volume_size': 1} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1429380141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90d66a2a-ebe4-48f2-8b8e-65c01cda678b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3499dece315344a48bb7bb5115005ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:06:57Z,use_quota=True,user_id='f9c6c13ce4ba4f3899bb37e7fc18e9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Creating volume 90d66a2a-ebe4-48f2-8b8e-65c01cda678b {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:06:56 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:06:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:56 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b 1073741824 Sep 01 02:06:56 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:57 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b 1073741824" returned: 0 in 0.810s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:06:57 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b Sep 01 02:06:57 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:06:58 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Sep 01 02:06:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b" returned: 0 in 0.432s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:06:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:06:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.347s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:06:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f3aa1fd-cf35-48ed-9833-33a670043c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e883b53-c03a-4ba7-97c3-3f53f8c8e0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:06:58 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Volume volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b (90d66a2a-ebe4-48f2-8b8e-65c01cda678b): created successfully Sep 01 02:06:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e883b53-c03a-4ba7-97c3-3f53f8c8e0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:06:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Flow 'volume_create_manager' (c3c24f5b-6f7d-4728-b1ac-1fd35da70fca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:06:58 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7f212014-5ebc-4ada-9ea3-01d3fafca1ac tempest-ServersNegativeTestJSON-698918746 None] Created volume successfully. Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Flow 'volume_create_manager' (6580df32-eac4-4f3f-a56d-8e143282a38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a98b6cb-6c71-4e75-adf2-56bfc823a828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a98b6cb-6c71-4e75-adf2-56bfc823a828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1070890180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045a621e-00ef-464f-94d6-adfee9f404b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3499dece315344a48bb7bb5115005ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:01Z,use_quota=True,user_id='f9c6c13ce4ba4f3899bb37e7fc18e9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfa38da-59b2-4885-abe6-ab8c072bd742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dfa38da-59b2-4885-abe6-ab8c072bd742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56525f68-c7cf-4127-85b1-bfc61f4825e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56525f68-c7cf-4127-85b1-bfc61f4825e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045a621e-00ef-464f-94d6-adfee9f404b6', 'volume_name': 'volume-045a621e-00ef-464f-94d6-adfee9f404b6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb25766-5376-4dde-aa79-f4c46174cda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcb25766-5376-4dde-aa79-f4c46174cda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62104ff-efd0-4915-b67b-c1d24c7cb99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:00 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Volume 045a621e-00ef-464f-94d6-adfee9f404b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045a621e-00ef-464f-94d6-adfee9f404b6', 'volume_size': 1} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1070890180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045a621e-00ef-464f-94d6-adfee9f404b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3499dece315344a48bb7bb5115005ae3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:01Z,use_quota=True,user_id='f9c6c13ce4ba4f3899bb37e7fc18e9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Creating volume 045a621e-00ef-464f-94d6-adfee9f404b6 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:00 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:07:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:00 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6 1073741824 Sep 01 02:07:00 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c21f399-f8a8-49ee-9b12-2a14442644b8 tempest-BackendsCapabilitiesAdminTestsJSON-52939673 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0478439331055, 'free_capacity_gb': 1774.0478439331055, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87389) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:07:01 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6 1073741824" returned: 0 in 0.639s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3d91e2e0-c741-44de-91db-240867b20a0e tempest-BackendsCapabilitiesAdminTestsJSON-52939673 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0478439331055, 'free_capacity_gb': 1774.0478439331055, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87389) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:07:01 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6 Sep 01 02:07:01 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:02 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6" returned: 0 in 0.474s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b62104ff-efd0-4915-b67b-c1d24c7cb99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045a621e-00ef-464f-94d6-adfee9f404b6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4897bf58-f34d-4ead-ac54-7028a2aa5233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:02 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Volume volume-045a621e-00ef-464f-94d6-adfee9f404b6 (045a621e-00ef-464f-94d6-adfee9f404b6): created successfully Sep 01 02:07:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4897bf58-f34d-4ead-ac54-7028a2aa5233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Flow 'volume_create_manager' (6580df32-eac4-4f3f-a56d-8e143282a38b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:02 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-30ece951-0362-44c6-af15-024c92595343 tempest-ServersNegativeTestJSON-698918746 None] Created volume successfully. Sep 01 02:07:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Acquiring lock "cinder-045a621e-00ef-464f-94d6-adfee9f404b6-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Lock "cinder-045a621e-00ef-464f-94d6-adfee9f404b6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Acquiring lock "cinder-quobyte-045a621e-00ef-464f-94d6-adfee9f404b6" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Lock "cinder-quobyte-045a621e-00ef-464f-94d6-adfee9f404b6" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:04 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0983ba55-7468-4ab1-89cd-ee3effadf809]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:04 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6 Sep 01 02:07:04 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:05 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6" returned: 0 in 0.784s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:05 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6 Sep 01 02:07:05 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:05 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-045a621e-00ef-464f-94d6-adfee9f404b6" returned: 0 in 0.379s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Lock "cinder-quobyte-045a621e-00ef-464f-94d6-adfee9f404b6" released by "delete_volume" :: held 1.233s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:05 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Created reservations ['35f853ab-de5b-4061-a324-a561606a7449', '52c8b9ad-7b0c-459a-b556-b4d2d05512ac', '64faba7d-ae33-41d5-be47-988b00355163', '09ed2f8c-6bf8-4ac4-b6d1-ddff3bb2396a'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:05 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:07:05 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:06 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.366s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:06 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Deleted volume successfully. Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f56ed48-ec05-4cdf-a188-f5edf9c7f175 tempest-ServersNegativeTestJSON-698918746 None] Lock "cinder-045a621e-00ef-464f-94d6-adfee9f404b6-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Acquiring lock "cinder-90d66a2a-ebe4-48f2-8b8e-65c01cda678b-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Lock "cinder-90d66a2a-ebe4-48f2-8b8e-65c01cda678b-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Acquiring lock "cinder-quobyte-90d66a2a-ebe4-48f2-8b8e-65c01cda678b" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Lock "cinder-quobyte-90d66a2a-ebe4-48f2-8b8e-65c01cda678b" acquired by "delete_volume" :: waited 0.044s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42e227e-7c5f-4f36-b721-89cc45052349]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Flow 'volume_create_manager' (1747434b-8340-4cb2-bd0d-93b2c0562a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8daffc6-5ba5-4472-8366-082c8b320052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:06 devstack sudo[93226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b Sep 01 02:07:06 devstack sudo[93226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8daffc6-5ba5-4472-8366-082c8b320052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1781980727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3996338d-4b5b-4018-8442-d2f38941adcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87334e0ae0444292a62aa3477e6cf73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:07Z,use_quota=True,user_id='a16768976cf24aa0a3fb4f7a37b116f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0639110-9762-41a7-87b0-9301eb92b57c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0639110-9762-41a7-87b0-9301eb92b57c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf8f137-72ba-48f8-9fe6-ec26791ed70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf8f137-72ba-48f8-9fe6-ec26791ed70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3996338d-4b5b-4018-8442-d2f38941adcd', 'volume_name': 'volume-3996338d-4b5b-4018-8442-d2f38941adcd', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0de2d97-6e58-40ca-8c91-b1e5f9698e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0de2d97-6e58-40ca-8c91-b1e5f9698e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e85739-5170-4afc-93ba-c88287699a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:06 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Volume 3996338d-4b5b-4018-8442-d2f38941adcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3996338d-4b5b-4018-8442-d2f38941adcd', 'volume_size': 1} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1781980727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3996338d-4b5b-4018-8442-d2f38941adcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87334e0ae0444292a62aa3477e6cf73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:07Z,use_quota=True,user_id='a16768976cf24aa0a3fb4f7a37b116f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Creating volume 3996338d-4b5b-4018-8442-d2f38941adcd {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:06 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:07:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:07 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd 1073741824 Sep 01 02:07:07 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:07 devstack sudo[93226]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b" returned: 0 in 0.618s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:07 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b Sep 01 02:07:07 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:07 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd 1073741824" returned: 0 in 0.818s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:07 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-90d66a2a-ebe4-48f2-8b8e-65c01cda678b" returned: 0 in 0.612s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Lock "cinder-quobyte-90d66a2a-ebe4-48f2-8b8e-65c01cda678b" released by "delete_volume" :: held 1.308s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:08 devstack sudo[93241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd Sep 01 02:07:08 devstack sudo[93241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Created reservations ['3c8c475a-0877-4d16-8d0b-ac17e547667b', '13e01a3f-c9ef-4587-b7b4-98cefd5843fb', '01bb63b9-b5bc-497e-bdea-eb0aea6efd3a', '183caa11-54e8-4240-9120-5f43b10d118e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:08 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:07:08 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:08 devstack sudo[93241]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd" returned: 0 in 0.776s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] <== create_volume: return (1752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7e85739-5170-4afc-93ba-c88287699a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3996338d-4b5b-4018-8442-d2f38941adcd', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5126537a-9424-4463-a0eb-2cb5fd057710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:08 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Volume volume-3996338d-4b5b-4018-8442-d2f38941adcd (3996338d-4b5b-4018-8442-d2f38941adcd): created successfully Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5126537a-9424-4463-a0eb-2cb5fd057710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Flow 'volume_create_manager' (1747434b-8340-4cb2-bd0d-93b2c0562a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:09 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d7251606-e32c-478a-a846-c6a2a742ef1d tempest-SnapshotMetadataTestJSON-1274812658 None] Created volume successfully. Sep 01 02:07:09 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.646s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:09 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:09 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Deleted volume successfully. Sep 01 02:07:09 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebcaa5a2-415c-406c-8cfa-969c4a716805 tempest-ServersNegativeTestJSON-698918746 None] Lock "cinder-90d66a2a-ebe4-48f2-8b8e-65c01cda678b-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] Creating offline snapshot 9186c9c7-1d10-48a2-b38a-6cb2e6e2172e of volume 3996338d-4b5b-4018-8442-d2f38941adcd {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:07:10 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0f61b2-e662-4458-aea5-a7302903c454]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:10 devstack sudo[93320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd Sep 01 02:07:10 devstack sudo[93320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:11 devstack sudo[93320]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd" returned: 0 in 1.270s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:11 devstack sudo[93342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e 1G Sep 01 02:07:11 devstack sudo[93342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:12 devstack sudo[93342]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e 1G" returned: 0 in 0.916s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3996338d-4b5b-4018-8442-d2f38941adcd -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:12 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3996338d-4b5b-4018-8442-d2f38941adcd -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e Sep 01 02:07:12 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:13 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3996338d-4b5b-4018-8442-d2f38941adcd -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e" returned: 0 in 0.694s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:13 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e is being set with open permissions: ugo+rw Sep 01 02:07:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:13 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e Sep 01 02:07:13 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:13 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e" returned: 0 in 0.736s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:14 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.info Sep 01 02:07:14 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:14 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.info" returned: 0 in 0.459s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:14 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.info is being set with open permissions: ugo+rw Sep 01 02:07:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:14 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.info Sep 01 02:07:14 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:14 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.info" returned: 0 in 0.371s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.672s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1aa2b31e-fd01-482c-b71d-5f1c002ffe7d tempest-SnapshotMetadataTestJSON-1274812658 None] Create snapshot completed successfully Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Acquiring lock "cinder-9186c9c7-1d10-48a2-b38a-6cb2e6e2172e-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "cinder-9186c9c7-1d10-48a2-b38a-6cb2e6e2172e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Acquiring lock "cinder-quobyte-3996338d-4b5b-4018-8442-d2f38941adcd" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "cinder-quobyte-3996338d-4b5b-4018-8442-d2f38941adcd" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Acquiring lock "cinder-quobyte-9186c9c7-1d10-48a2-b38a-6cb2e6e2172e" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "cinder-quobyte-9186c9c7-1d10-48a2-b38a-6cb2e6e2172e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Deleting offline snapshot 9186c9c7-1d10-48a2-b38a-6cb2e6e2172e of volume 3996338d-4b5b-4018-8442-d2f38941adcd {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] snapshot_file for this snap is: volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9365640a-14e9-46b4-8d61-f59a8007d1a8]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:17 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e Sep 01 02:07:17 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:17 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e" returned: 0 in 0.468s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3996338d-4b5b-4018-8442-d2f38941adcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce5cfb6-85f0-449c-a291-34dd7ff1ff59]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:17 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd Sep 01 02:07:17 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:18 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd" returned: 0 in 0.582s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:18 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e Sep 01 02:07:18 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:18 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e" returned: 0 in 0.395s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:18 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e Sep 01 02:07:18 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:19 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd.9186c9c7-1d10-48a2-b38a-6cb2e6e2172e" returned: 0 in 0.268s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "cinder-quobyte-9186c9c7-1d10-48a2-b38a-6cb2e6e2172e" released by "_delete_snapshot" :: held 1.860s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "cinder-quobyte-3996338d-4b5b-4018-8442-d2f38941adcd" released by "delete_snapshot" :: held 1.909s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:19 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Created reservations ['47971d24-7024-478c-a456-0a8b8241d30d', '558deec5-74d8-4ccf-9516-2d7c7f0cef32', 'c67a12d8-ad99-4aed-9572-88e7afceb971', '98ed7d99-8fd4-4f69-a278-ccec4b99a51e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Delete snapshot completed successfully. Sep 01 02:07:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8c357bea-d0e0-4bca-bc9c-da7927d1adf1 tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "cinder-9186c9c7-1d10-48a2-b38a-6cb2e6e2172e-delete_snapshot" released by "delete_snapshot" :: held 2.188s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Acquiring lock "cinder-3996338d-4b5b-4018-8442-d2f38941adcd-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "cinder-3996338d-4b5b-4018-8442-d2f38941adcd-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Acquiring lock "cinder-quobyte-3996338d-4b5b-4018-8442-d2f38941adcd" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "cinder-quobyte-3996338d-4b5b-4018-8442-d2f38941adcd" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:20 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b16ecb2-f6a1-4ee1-b8f6-d34294a6c7a4]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:20 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd Sep 01 02:07:20 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:20 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd" returned: 0 in 0.555s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:20 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd Sep 01 02:07:20 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:21 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3996338d-4b5b-4018-8442-d2f38941adcd" returned: 0 in 0.528s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "cinder-quobyte-3996338d-4b5b-4018-8442-d2f38941adcd" released by "delete_volume" :: held 1.198s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Created reservations ['441171a5-5c1a-4d50-9c11-5e1d7938e2d8', '7c72f1f0-4615-4a52-a802-db8ec25e926f', '393a181e-863e-43f7-8f70-e01febb39ed5', '5292bb52-3e0d-405a-bef0-17aacd327bf2'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:21 devstack sudo[93450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:07:21 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fb3b29ec-0e85-4612-99dc-ec772410f353 tempest-GroupsTest-784594137 None] Group tempest-Group1-919217123: creating Sep 01 02:07:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fb3b29ec-0e85-4612-99dc-ec772410f353 tempest-GroupsTest-784594137 None] Group tempest-Group1-919217123: created successfully Sep 01 02:07:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fb3b29ec-0e85-4612-99dc-ec772410f353 tempest-GroupsTest-784594137 None] Create group completed successfully. Sep 01 02:07:21 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.345s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Deleted volume successfully. Sep 01 02:07:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e620fba2-a835-4181-b247-00ff4ec9cb0b tempest-SnapshotMetadataTestJSON-1274812658 None] Lock "cinder-3996338d-4b5b-4018-8442-d2f38941adcd-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:22 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-62669d7d-3d1b-4dcc-881d-b3a3c5f534bf tempest-GroupsTest-784594137 None] Group tempest-Group2-161151414: creating Sep 01 02:07:22 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-62669d7d-3d1b-4dcc-881d-b3a3c5f534bf tempest-GroupsTest-784594137 None] Group tempest-Group2-161151414: created successfully Sep 01 02:07:22 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-62669d7d-3d1b-4dcc-881d-b3a3c5f534bf tempest-GroupsTest-784594137 None] Create group completed successfully. Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Flow 'volume_create_manager' (9df5fe84-1ce6-430c-9035-07cff2811145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060b0798-6530-4fb9-95f7-63646267bba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (060b0798-6530-4fb9-95f7-63646267bba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1623275130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fe762b6-78ea-4440-81e0-cd33cdabcb5c,host='devstack@QuobyteHD#QuobyteHD',id=4dd3589e-2236-4314-b0e4-ff26292d0da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6948def1dc8f4b00b66b06d3830d832c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:25Z,use_quota=True,user_id='f8b8021cf0dd4af5abcb85ccf3507c26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef527a54-2052-4f3b-831d-3a357a2b8d1d),volume_type_id=ef527a54-2052-4f3b-831d-3a357a2b8d1d)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fb9127-f972-4f03-b2a5-c7dc3080e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16fb9127-f972-4f03-b2a5-c7dc3080e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9785c1d0-7baf-487c-8947-9966e2a4a88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9785c1d0-7baf-487c-8947-9966e2a4a88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd3589e-2236-4314-b0e4-ff26292d0da4', 'volume_name': 'volume-4dd3589e-2236-4314-b0e4-ff26292d0da4', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08537a86-a899-4aca-9ec8-442b6664e7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08537a86-a899-4aca-9ec8-442b6664e7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99abaad3-842f-4234-9d03-8f3b7d2bace3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:24 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Volume 4dd3589e-2236-4314-b0e4-ff26292d0da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd3589e-2236-4314-b0e4-ff26292d0da4', 'volume_size': 1} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8fe762b6-78ea-4440-81e0-cd33cdabcb5c,created_at=2026-09-01T00:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1623275130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8fe762b6-78ea-4440-81e0-cd33cdabcb5c,host='devstack@QuobyteHD#QuobyteHD',id=4dd3589e-2236-4314-b0e4-ff26292d0da4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6948def1dc8f4b00b66b06d3830d832c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:25Z,use_quota=True,user_id='f8b8021cf0dd4af5abcb85ccf3507c26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef527a54-2052-4f3b-831d-3a357a2b8d1d),volume_type_id=ef527a54-2052-4f3b-831d-3a357a2b8d1d)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Creating volume 4dd3589e-2236-4314-b0e4-ff26292d0da4 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:24 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:07:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:24 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4 1073741824 Sep 01 02:07:24 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:25 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4 1073741824" returned: 0 in 0.562s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:25 devstack sudo[93482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4 Sep 01 02:07:25 devstack sudo[93482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:25 devstack sudo[93482]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4" returned: 0 in 0.342s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99abaad3-842f-4234-9d03-8f3b7d2bace3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd3589e-2236-4314-b0e4-ff26292d0da4', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f5489b-79d4-4c60-a766-2e2ab4aa48c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:25 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Volume volume-4dd3589e-2236-4314-b0e4-ff26292d0da4 (4dd3589e-2236-4314-b0e4-ff26292d0da4): created successfully Sep 01 02:07:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f5489b-79d4-4c60-a766-2e2ab4aa48c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Flow 'volume_create_manager' (9df5fe84-1ce6-430c-9035-07cff2811145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-04228a43-66ba-4975-a42a-bed7a43efc55 tempest-GroupsTest-784594137 None] Created volume successfully. Sep 01 02:07:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Acquiring lock "cinder-quobyte-4dd3589e-2236-4314-b0e4-ff26292d0da4" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Lock "cinder-quobyte-4dd3589e-2236-4314-b0e4-ff26292d0da4" acquired by "delete_volume" :: waited 0.035s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:27 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb26967-4327-452f-8827-181b930cda47]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:28 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4 Sep 01 02:07:28 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:28 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4" returned: 0 in 0.464s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:28 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4 Sep 01 02:07:28 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:28 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4dd3589e-2236-4314-b0e4-ff26292d0da4" returned: 0 in 0.284s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Lock "cinder-quobyte-4dd3589e-2236-4314-b0e4-ff26292d0da4" released by "delete_volume" :: held 0.810s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Created reservations ['fb68dc14-386d-4baa-8002-5edb815cee0f'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:28 devstack cinder-volume[87389]: WARNING cinder.quota [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-640656758 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-640656758, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:28 devstack cinder-volume[87389]: WARNING cinder.quota [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-640656758 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-640656758, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Created reservations ['446e12a3-13ab-48cc-ae55-ba16e2b73a2a', '625c7662-b57c-48b6-a436-6732af9d1a00', '70d592f4-36ba-4bc5-9fbd-7160d3c6f393', '890d48e5-d275-4f28-ba27-0dbc447bcc1c'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:28 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:07:28 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:29 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.301s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:29 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:29 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-89ec7589-8f14-4dc6-be16-115a913801b1 tempest-GroupsTest-784594137 None] Created reservations ['a7dc313d-7c0b-416d-b735-5cb4fbada7cf'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:29 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9b2f56ea-bf4d-43cd-b146-90f31269e36b tempest-GroupsTest-784594137 None] Delete group completed successfully. Sep 01 02:07:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-89ec7589-8f14-4dc6-be16-115a913801b1 tempest-GroupsTest-784594137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-89ec7589-8f14-4dc6-be16-115a913801b1 tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-89ec7589-8f14-4dc6-be16-115a913801b1 tempest-GroupsTest-784594137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-89ec7589-8f14-4dc6-be16-115a913801b1 tempest-GroupsTest-784594137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-89ec7589-8f14-4dc6-be16-115a913801b1 tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-89ec7589-8f14-4dc6-be16-115a913801b1 tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:29 devstack sudo[93496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:07:29 devstack sudo[93496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:29 devstack sudo[93496]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-89ec7589-8f14-4dc6-be16-115a913801b1 tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.330s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:29 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-89ec7589-8f14-4dc6-be16-115a913801b1 tempest-GroupsTest-784594137 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:29 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-89ec7589-8f14-4dc6-be16-115a913801b1 tempest-GroupsTest-784594137 None] Delete group completed successfully. Sep 01 02:07:31 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-947c0b62-0597-48d2-af03-47312a6cac45 tempest-GroupsTest-784594137 None] Group tempest-GroupsTest-Group-623485026: creating Sep 01 02:07:31 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-947c0b62-0597-48d2-af03-47312a6cac45 tempest-GroupsTest-784594137 None] Group tempest-GroupsTest-Group-623485026: created successfully Sep 01 02:07:31 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-947c0b62-0597-48d2-af03-47312a6cac45 tempest-GroupsTest-784594137 None] Create group completed successfully. Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Flow 'volume_create_manager' (f24795ac-72db-4c10-828b-561b39c5eb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc72bf7-1073-420e-ae58-5b021dca767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc72bf7-1073-420e-ae58-5b021dca767c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-566293648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fe07d8-ab09-4ce5-97f6-ea2049f5eacd,host='devstack@QuobyteHD#QuobyteHD',id=ed01a371-fa7f-430d-9750-a2edcb082379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6948def1dc8f4b00b66b06d3830d832c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:33Z,use_quota=True,user_id='f8b8021cf0dd4af5abcb85ccf3507c26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d508c15a-45f6-460f-9a66-22bbd52ed462),volume_type_id=d508c15a-45f6-460f-9a66-22bbd52ed462)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ca16ae-d571-4060-bef1-11e948161224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ca16ae-d571-4060-bef1-11e948161224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e95aa97-b845-4a4f-82aa-e497787eea1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e95aa97-b845-4a4f-82aa-e497787eea1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed01a371-fa7f-430d-9750-a2edcb082379', 'volume_name': 'volume-ed01a371-fa7f-430d-9750-a2edcb082379', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441babad-cda5-40e1-96ad-dc1ad7964c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (441babad-cda5-40e1-96ad-dc1ad7964c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1830e4f7-0994-468f-8dba-eb18ac36fc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:33 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Volume ed01a371-fa7f-430d-9750-a2edcb082379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed01a371-fa7f-430d-9750-a2edcb082379', 'volume_size': 1} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56fe07d8-ab09-4ce5-97f6-ea2049f5eacd,created_at=2026-09-01T00:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-566293648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fe07d8-ab09-4ce5-97f6-ea2049f5eacd,host='devstack@QuobyteHD#QuobyteHD',id=ed01a371-fa7f-430d-9750-a2edcb082379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6948def1dc8f4b00b66b06d3830d832c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:33Z,use_quota=True,user_id='f8b8021cf0dd4af5abcb85ccf3507c26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d508c15a-45f6-460f-9a66-22bbd52ed462),volume_type_id=d508c15a-45f6-460f-9a66-22bbd52ed462)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Creating volume ed01a371-fa7f-430d-9750-a2edcb082379 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:33 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:07:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:33 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379 1073741824 Sep 01 02:07:33 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:34 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379 1073741824" returned: 0 in 0.695s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:34 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379 Sep 01 02:07:34 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:34 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379" returned: 0 in 0.588s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1830e4f7-0994-468f-8dba-eb18ac36fc3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed01a371-fa7f-430d-9750-a2edcb082379', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041a62bd-0a76-4887-9f01-74be0af77cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Flow 'volume_create_manager' (c8fc3caa-6a34-4ec7-a729-f18df5fe22a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a1f974-39ab-48ea-a387-de8fa0684549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:34 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Volume volume-ed01a371-fa7f-430d-9750-a2edcb082379 (ed01a371-fa7f-430d-9750-a2edcb082379): created successfully Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (041a62bd-0a76-4887-9f01-74be0af77cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Flow 'volume_create_manager' (f24795ac-72db-4c10-828b-561b39c5eb64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23a1f974-39ab-48ea-a387-de8fa0684549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1943231109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81417fb9-2fb0-4852-beb3-c575b6eeffe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b709c95a1a463eac1dc2da31a10685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:35Z,use_quota=True,user_id='5a74802e23ba4b05ac050cd4ca609f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac80034-312e-4697-b5ce-5615bb7565cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ac80034-312e-4697-b5ce-5615bb7565cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae5681c-97a8-4916-9793-903b92a2d20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae5681c-97a8-4916-9793-903b92a2d20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81417fb9-2fb0-4852-beb3-c575b6eeffe9', 'volume_name': 'volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bf0739-6315-4c87-9c41-3cf6e55e1b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bf0739-6315-4c87-9c41-3cf6e55e1b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b837136-a8f3-4e60-b8af-882c1fe5c78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:35 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Volume 81417fb9-2fb0-4852-beb3-c575b6eeffe9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9', 'volume_size': 1} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1943231109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81417fb9-2fb0-4852-beb3-c575b6eeffe9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14b709c95a1a463eac1dc2da31a10685',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:35Z,use_quota=True,user_id='5a74802e23ba4b05ac050cd4ca609f65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Creating volume 81417fb9-2fb0-4852-beb3-c575b6eeffe9 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:35 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:35 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6b97fa66-39b9-4ebe-b2f2-10e7ebfed8ca tempest-GroupsTest-784594137 None] Created volume successfully. Sep 01 02:07:35 devstack sudo[93513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9 1073741824 Sep 01 02:07:35 devstack sudo[93513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:35 devstack sudo[93513]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9 1073741824" returned: 0 in 0.575s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:35 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9 Sep 01 02:07:35 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:36 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9" returned: 0 in 0.391s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b837136-a8f3-4e60-b8af-882c1fe5c78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4910281-3e01-40ff-b027-354985ab8ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:36 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Volume volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9 (81417fb9-2fb0-4852-beb3-c575b6eeffe9): created successfully Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4910281-3e01-40ff-b027-354985ab8ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Flow 'volume_create_manager' (c8fc3caa-6a34-4ec7-a729-f18df5fe22a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:36 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f851cd5c-212c-4c34-b638-710087da4d22 tempest-AttachVolumeNegativeTest-1397741062 None] Created volume successfully. Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Flow 'volume_create_manager' (8bead4b4-b79a-4b49-8678-83c4a4a6a102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29518210-bfe7-41ae-938c-d16be9acecfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29518210-bfe7-41ae-938c-d16be9acecfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2060622971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fe07d8-ab09-4ce5-97f6-ea2049f5eacd,host='devstack@QuobyteHD#QuobyteHD',id=4c5da0b3-295b-4094-b74b-4264b6d5926c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6948def1dc8f4b00b66b06d3830d832c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:37Z,use_quota=True,user_id='f8b8021cf0dd4af5abcb85ccf3507c26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d508c15a-45f6-460f-9a66-22bbd52ed462),volume_type_id=d508c15a-45f6-460f-9a66-22bbd52ed462)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d64a328-1137-4902-88ae-3c7272b5b1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d64a328-1137-4902-88ae-3c7272b5b1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d424ce-7255-4097-8738-9e33a1f1fe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d424ce-7255-4097-8738-9e33a1f1fe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5da0b3-295b-4094-b74b-4264b6d5926c', 'volume_name': 'volume-4c5da0b3-295b-4094-b74b-4264b6d5926c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552e576d-0c99-4551-860e-1078d6662acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552e576d-0c99-4551-860e-1078d6662acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33be0e01-1d2a-4890-9b76-721efbe865dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:36 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Volume 4c5da0b3-295b-4094-b74b-4264b6d5926c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5da0b3-295b-4094-b74b-4264b6d5926c', 'volume_size': 1} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56fe07d8-ab09-4ce5-97f6-ea2049f5eacd,created_at=2026-09-01T00:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2060622971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56fe07d8-ab09-4ce5-97f6-ea2049f5eacd,host='devstack@QuobyteHD#QuobyteHD',id=4c5da0b3-295b-4094-b74b-4264b6d5926c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6948def1dc8f4b00b66b06d3830d832c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:37Z,use_quota=True,user_id='f8b8021cf0dd4af5abcb85ccf3507c26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d508c15a-45f6-460f-9a66-22bbd52ed462),volume_type_id=d508c15a-45f6-460f-9a66-22bbd52ed462)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Creating volume 4c5da0b3-295b-4094-b74b-4264b6d5926c {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:36 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:07:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:36 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c 1073741824 Sep 01 02:07:36 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:37 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c 1073741824" returned: 0 in 0.601s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:37 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c Sep 01 02:07:37 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:37 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c" returned: 0 in 0.294s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33be0e01-1d2a-4890-9b76-721efbe865dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5da0b3-295b-4094-b74b-4264b6d5926c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba7d60c-0c4e-4729-bba5-066cdbd5be3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:37 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Volume volume-4c5da0b3-295b-4094-b74b-4264b6d5926c (4c5da0b3-295b-4094-b74b-4264b6d5926c): created successfully Sep 01 02:07:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba7d60c-0c4e-4729-bba5-066cdbd5be3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Flow 'volume_create_manager' (8bead4b4-b79a-4b49-8678-83c4a4a6a102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:37 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-104930c6-b445-46dd-ab47-3bef0d949e11 tempest-GroupsTest-784594137 None] Created volume successfully. Sep 01 02:07:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-dc422184-18d1-42e0-aff9-46cea6244d62 req-997143ab-8f48-4582-9093-34fdaa4b5609 tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-dc422184-18d1-42e0-aff9-46cea6244d62 req-997143ab-8f48-4582-9093-34fdaa4b5609 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-dc422184-18d1-42e0-aff9-46cea6244d62 req-997143ab-8f48-4582-9093-34fdaa4b5609 tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-dc422184-18d1-42e0-aff9-46cea6244d62 req-997143ab-8f48-4582-9093-34fdaa4b5609 tempest-AttachVolumeNegativeTest-1397741062 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e791e8d-2856-4228-8143-e95f519e8a58', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:07:38 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-dc422184-18d1-42e0-aff9-46cea6244d62 req-997143ab-8f48-4582-9093-34fdaa4b5609 tempest-AttachVolumeNegativeTest-1397741062 None] attachment_update completed successfully. Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Flow 'volume_create_manager' (82b4bdbe-ffa2-4dcd-a212-d2bbf4528545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1a1c62-a374-43ad-b05b-33965cacaf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e1a1c62-a374-43ad-b05b-33965cacaf41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1728613029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc42c1ff-37c8-4eb7-89a0-3078c17de4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e65dcd488c45bba7471b3b65080047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:39Z,use_quota=True,user_id='038fe05b007f43539ddd80fe6731faf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c301c31-6fd7-4894-b136-d36ecaed3379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c301c31-6fd7-4894-b136-d36ecaed3379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda66df1-7f17-4de3-8025-aa9f331af13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda66df1-7f17-4de3-8025-aa9f331af13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc42c1ff-37c8-4eb7-89a0-3078c17de4c8', 'volume_name': 'volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1d70f6-dc87-49e1-928f-c0acd7e39dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1d70f6-dc87-49e1-928f-c0acd7e39dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a087edd-c400-464e-aa64-69219990ad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:39 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Volume fc42c1ff-37c8-4eb7-89a0-3078c17de4c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8', 'volume_size': 1} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1728613029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc42c1ff-37c8-4eb7-89a0-3078c17de4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e65dcd488c45bba7471b3b65080047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:07:39Z,use_quota=True,user_id='038fe05b007f43539ddd80fe6731faf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Creating volume fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:07:39 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:07:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1b18fe96-da74-429d-8fd2-7097816f95f8 tempest-GroupsTest-784594137 None] Update group completed successfully. Sep 01 02:07:39 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 1073741824 Sep 01 02:07:39 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:40 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 1073741824" returned: 0 in 0.608s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:40 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 Sep 01 02:07:40 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:40 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" returned: 0 in 0.572s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:07:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a087edd-c400-464e-aa64-69219990ad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a01772-5279-4e88-a4c1-fd77a48e3f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:07:40 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Volume volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 (fc42c1ff-37c8-4eb7-89a0-3078c17de4c8): created successfully Sep 01 02:07:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a01772-5279-4e88-a4c1-fd77a48e3f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:07:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Flow 'volume_create_manager' (82b4bdbe-ffa2-4dcd-a212-d2bbf4528545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:07:40 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-051a1222-9b3f-4dac-8c19-a520f3c9b0a6 tempest-VolumesActionsTest-1616439687 None] Created volume successfully. Sep 01 02:07:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-6dae0dab-d0fd-4761-b4bd-06b254f4ff67 req-b9a18ee3-06dd-4aea-9837-16834867a2ae tempest-AttachVolumeNegativeTest-1397741062 None] Terminate volume connection completed successfully. Sep 01 02:07:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-6dae0dab-d0fd-4761-b4bd-06b254f4ff67 req-b9a18ee3-06dd-4aea-9837-16834867a2ae tempest-AttachVolumeNegativeTest-1397741062 None] Deleting attachment 0e791e8d-2856-4228-8143-e95f519e8a58. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:07:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2861e985-3dbb-4ae1-8b76-964d2b991d0f tempest-GroupsTest-784594137 None] Update group completed successfully. Sep 01 02:07:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Acquiring lock "cinder-quobyte-4c5da0b3-295b-4094-b74b-4264b6d5926c" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Lock "cinder-quobyte-4c5da0b3-295b-4094-b74b-4264b6d5926c" acquired by "delete_volume" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:43 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d13aafc-217e-41c9-b910-2aa507bdf821]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:43 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c Sep 01 02:07:43 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:43 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c" returned: 0 in 0.631s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:44 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c Sep 01 02:07:44 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:44 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4c5da0b3-295b-4094-b74b-4264b6d5926c" returned: 0 in 0.411s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Lock "cinder-quobyte-4c5da0b3-295b-4094-b74b-4264b6d5926c" released by "delete_volume" :: held 1.109s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Acquiring lock "cinder-quobyte-ed01a371-fa7f-430d-9750-a2edcb082379" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Lock "cinder-quobyte-ed01a371-fa7f-430d-9750-a2edcb082379" acquired by "delete_volume" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[272b91f7-cf31-4e75-b4c0-21b790468073]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:44 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379 Sep 01 02:07:44 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:45 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379" returned: 0 in 0.768s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:45 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379 Sep 01 02:07:45 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:45 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ed01a371-fa7f-430d-9750-a2edcb082379" returned: 0 in 0.468s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Lock "cinder-quobyte-ed01a371-fa7f-430d-9750-a2edcb082379" released by "delete_volume" :: held 1.310s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:45 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Created reservations ['8a339bd3-6b3c-43f3-80e8-e7c30388a28c'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:46 devstack cinder-volume[87389]: WARNING cinder.quota [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-397145877 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-397145877, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:46 devstack cinder-volume[87389]: WARNING cinder.quota [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-397145877 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-397145877, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:07:46 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Created reservations ['df95c228-8f55-4442-817d-815d5a1ad7df', '738015e9-48fa-4710-a8b4-3e100beb4377', '17e62030-afe2-4c9c-b390-7d4a219e5cfd', 'a1611e54-4098-4d4e-9ebd-5fbb758d9951'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:46 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Created reservations ['1ad818f3-5452-4d1c-a847-2d05851974ce', '39c76c75-5948-4266-af3a-8a91549e9798', '22d8b14c-fe47-41d2-8be4-1c039c0efa29', '75f429c4-d14a-4e74-adb4-90e78d654d6a'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:46 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:07:46 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:47 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.485s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:47 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-75a4ea68-fd8a-4955-b925-0f48fdac7bb1 tempest-GroupsTest-784594137 None] Delete group completed successfully. Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:47 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:07:47 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:47 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.386s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:07:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:07:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "cinder-81417fb9-2fb0-4852-beb3-c575b6eeffe9-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-81417fb9-2fb0-4852-beb3-c575b6eeffe9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:48 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=89,cinder:INSERT=24,cinder:UPDATE=110,cinder:DELETE=7 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:48 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=98,cinder:INSERT=24,cinder:UPDATE=104,cinder:DELETE=6 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:07:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "cinder-quobyte-81417fb9-2fb0-4852-beb3-c575b6eeffe9" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-quobyte-81417fb9-2fb0-4852-beb3-c575b6eeffe9" acquired by "delete_volume" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:48 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f5855a-5c7d-4c75-9896-6ddd1abd1607]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:48 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9 Sep 01 02:07:48 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:49 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9" returned: 0 in 0.509s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:49 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9 Sep 01 02:07:49 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:49 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81417fb9-2fb0-4852-beb3-c575b6eeffe9" returned: 0 in 0.293s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-quobyte-81417fb9-2fb0-4852-beb3-c575b6eeffe9" released by "delete_volume" :: held 0.892s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Created reservations ['7c1dfba1-1dda-4c47-a132-4ea894998475', 'c8ccd75f-e5a0-4c1e-9f7c-c8306292284b', 'ae3d5322-6952-42e0-9890-8366a3c2dbe9', 'e7631968-2a48-4435-b989-5859105aa204'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:49 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:07:49 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "cinder-fe42079d-5778-4258-a560-b1481db3b04f-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-fe42079d-5778-4258-a560-b1481db3b04f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "cinder-quobyte-fe42079d-5778-4258-a560-b1481db3b04f" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.410s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:50 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:50 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-quobyte-fe42079d-5778-4258-a560-b1481db3b04f" acquired by "delete_volume" :: waited 0.066s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:50 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Deleted volume successfully. Sep 01 02:07:50 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f22d53b-38d3-4d04-b829-b2666f03c255]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb5e66a8-b8bb-4926-849e-8ca16c1450dc tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-81417fb9-2fb0-4852-beb3-c575b6eeffe9-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:50 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f Sep 01 02:07:50 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:50 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f" returned: 0 in 0.486s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:50 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f Sep 01 02:07:50 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:50 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fe42079d-5778-4258-a560-b1481db3b04f" returned: 0 in 0.324s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-quobyte-fe42079d-5778-4258-a560-b1481db3b04f" released by "delete_volume" :: held 0.884s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Created reservations ['639d6bb3-a9b2-47fc-9c1e-729ca2c32c03', 'fb99b971-4769-4f72-82eb-8c3d896729f1', '18db7d2b-a389-4005-bfde-69bede9e1e11', '462df283-d3ef-4085-b681-ffce05078c61'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:51 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:07:51 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "cinder-870ddb42-0b7b-415e-94ee-ca2855cc6f81-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-870ddb42-0b7b-415e-94ee-ca2855cc6f81-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "cinder-quobyte-870ddb42-0b7b-415e-94ee-ca2855cc6f81" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-quobyte-870ddb42-0b7b-415e-94ee-ca2855cc6f81" acquired by "delete_volume" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:51 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.403s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Deleted volume successfully. Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[333922b9-8089-431c-92b6-f0495eabecd7]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-80f14c44-dad7-4b2c-a15b-390db2e3e5bb tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-fe42079d-5778-4258-a560-b1481db3b04f-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:51 devstack sudo[94075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81 Sep 01 02:07:51 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:52 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81" returned: 0 in 0.576s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:52 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81 Sep 01 02:07:52 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:52 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-870ddb42-0b7b-415e-94ee-ca2855cc6f81" returned: 0 in 0.678s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-quobyte-870ddb42-0b7b-415e-94ee-ca2855cc6f81" released by "delete_volume" :: held 1.328s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:52 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Created reservations ['bdec7c6c-5be7-421a-b485-decde93cdb62', '4e7a0c1b-ee3a-46ec-b57d-f50332c12220', '91f35718-0ee6-4b53-b526-9be8327065c0', 'cb3b3ab5-890d-4004-b1ee-17525dd718c1'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:07:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:07:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:07:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:07:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:07:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:07:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:07:53 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:07:53 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:07:53 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Sep 01 02:07:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.487s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:07:53 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:07:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Deleted volume successfully. Sep 01 02:07:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-503eda5c-a294-470e-9f77-58933cee998c tempest-AttachVolumeNegativeTest-1397741062 None] Lock "cinder-870ddb42-0b7b-415e-94ee-ca2855cc6f81-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9d76d015-9058-4f08-8159-c6b721a810b7 tempest-VolumesActionsTest-1616439687 None] Acquiring lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" by "attach_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9d76d015-9058-4f08-8159-c6b721a810b7 tempest-VolumesActionsTest-1616439687 None] Lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" acquired by "attach_volume" :: waited 0.071s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:57 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9d76d015-9058-4f08-8159-c6b721a810b7 tempest-VolumesActionsTest-1616439687 None] Attaching volume fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 to instance b02ee667-11a5-4eb7-9d2c-e3c13345afa0 at mountpoint /dev/vdb on host None. Sep 01 02:07:57 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9d76d015-9058-4f08-8159-c6b721a810b7 tempest-VolumesActionsTest-1616439687 None] Attach volume completed successfully. Sep 01 02:07:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9d76d015-9058-4f08-8159-c6b721a810b7 tempest-VolumesActionsTest-1616439687 None] Lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" released by "attach_volume" :: held 0.311s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:07:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2fd6ea22-7db5-4e87-8ab4-106b6d5d7e37 tempest-VolumesActionsTest-1616439687 None] Acquiring lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8-detach_volume" by "detach_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:07:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2fd6ea22-7db5-4e87-8ab4-106b6d5d7e37 tempest-VolumesActionsTest-1616439687 None] Lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:07:58 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2fd6ea22-7db5-4e87-8ab4-106b6d5d7e37 tempest-VolumesActionsTest-1616439687 None] Detaching volume fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 from instance b02ee667-11a5-4eb7-9d2c-e3c13345afa0. Sep 01 02:07:58 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2fd6ea22-7db5-4e87-8ab4-106b6d5d7e37 tempest-VolumesActionsTest-1616439687 None] Detach volume completed successfully. Sep 01 02:07:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2fd6ea22-7db5-4e87-8ab4-106b6d5d7e37 tempest-VolumesActionsTest-1616439687 None] Lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8-detach_volume" released by "detach_volume" :: held 0.141s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:08 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=22,cinder:INSERT=9,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:08:08 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Flow 'volume_create_manager' (881b9a01-f828-43cb-97e9-fdb4a62de4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84feb4ec-b8d2-45d8-ad82-bdfe158459fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84feb4ec-b8d2-45d8-ad82-bdfe158459fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1453810407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c01a3bc-f32b-4bf1-8da6-20ac286eb39c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89739280ca614835bfbc2514a15362a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:10Z,use_quota=True,user_id='ff7d8e6cd8d54ffc9362f357b226aab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7957d93-dfe9-473a-827d-ee2daf386a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7957d93-dfe9-473a-827d-ee2daf386a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c626f3bb-3b42-49a0-949c-468152fe09c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c626f3bb-3b42-49a0-949c-468152fe09c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c01a3bc-f32b-4bf1-8da6-20ac286eb39c', 'volume_name': 'volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6d7e4e-2596-4ee0-a078-e7520d3a1f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa6d7e4e-2596-4ee0-a078-e7520d3a1f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c2b108-5b4d-4a6c-848e-270d5b981a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:10 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Volume 9c01a3bc-f32b-4bf1-8da6-20ac286eb39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c', 'volume_size': 1} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1453810407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c01a3bc-f32b-4bf1-8da6-20ac286eb39c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='89739280ca614835bfbc2514a15362a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:10Z,use_quota=True,user_id='ff7d8e6cd8d54ffc9362f357b226aab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Creating volume 9c01a3bc-f32b-4bf1-8da6-20ac286eb39c {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:10 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:10 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c 1073741824 Sep 01 02:08:10 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:10 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c 1073741824" returned: 0 in 0.455s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:10 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c Sep 01 02:08:10 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:11 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c" returned: 0 in 0.288s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c2b108-5b4d-4a6c-848e-270d5b981a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c93e1d0-3c56-42c4-ab57-ca5bf3fff50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:11 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Volume volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c (9c01a3bc-f32b-4bf1-8da6-20ac286eb39c): created successfully Sep 01 02:08:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c93e1d0-3c56-42c4-ab57-ca5bf3fff50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Flow 'volume_create_manager' (881b9a01-f828-43cb-97e9-fdb4a62de4cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:11 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-9b00f08e-6fb3-4530-a7d9-4b6c0b317bd7 req-1dce3d89-6150-4d9e-a9af-bf3c91b1b50f tempest-VolumesGetTestJSON-461719669 None] Created volume successfully. Sep 01 02:08:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Acquiring lock "cinder-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Lock "cinder-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Acquiring lock "cinder-quobyte-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Lock "cinder-quobyte-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:12 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a9da60-5f61-4c55-934c-ebeb35e0dac4]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:13 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c Sep 01 02:08:13 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:13 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c" returned: 0 in 0.578s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:13 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c Sep 01 02:08:13 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:13 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c" returned: 0 in 0.287s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Lock "cinder-quobyte-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c" released by "delete_volume" :: held 0.926s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:13 devstack cinder-volume[87389]: DEBUG cinder.quota [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Created reservations ['df2cdfbd-c28a-4b68-9c73-134203b54aa8', 'c90af0df-511f-41b8-8b5d-3ba390424b76', 'f1ffc96c-44a3-4687-bc16-2091dc4a4473', 'cf837c75-51b6-4a34-b2cb-70d643e977b0'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:13 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:08:13 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-519859c3-20d3-4905-b330-7635e64a69b3 tempest-VolumesActionsTest-1616439687 None] Acquiring lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" by "attach_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-519859c3-20d3-4905-b330-7635e64a69b3 tempest-VolumesActionsTest-1616439687 None] Lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" acquired by "attach_volume" :: waited 0.042s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-519859c3-20d3-4905-b330-7635e64a69b3 tempest-VolumesActionsTest-1616439687 None] Attaching volume fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 to instance 558f5b49-4919-43de-8ce1-47b74cdc3d99 at mountpoint /dev/vdb on host None. Sep 01 02:08:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-519859c3-20d3-4905-b330-7635e64a69b3 tempest-VolumesActionsTest-1616439687 None] Attach volume completed successfully. Sep 01 02:08:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-519859c3-20d3-4905-b330-7635e64a69b3 tempest-VolumesActionsTest-1616439687 None] Lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" released by "attach_volume" :: held 0.231s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:14 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.522s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:14 devstack cinder-volume[87389]: DEBUG cinder.manager [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Deleted volume successfully. Sep 01 02:08:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-99b6fe03-be34-4ccc-b47f-78f29f066b3c req-e1f86598-dc09-4e33-82fa-671882e1d9c1 tempest-VolumesGetTestJSON-461719669 None] Lock "cinder-9c01a3bc-f32b-4bf1-8da6-20ac286eb39c-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4936fed7-e774-4f29-a9d7-384c68ee4ad7 tempest-VolumesActionsTest-1616439687 None] Acquiring lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8-detach_volume" by "detach_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4936fed7-e774-4f29-a9d7-384c68ee4ad7 tempest-VolumesActionsTest-1616439687 None] Lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4936fed7-e774-4f29-a9d7-384c68ee4ad7 tempest-VolumesActionsTest-1616439687 None] Detaching volume fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 from instance 558f5b49-4919-43de-8ce1-47b74cdc3d99. Sep 01 02:08:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4936fed7-e774-4f29-a9d7-384c68ee4ad7 tempest-VolumesActionsTest-1616439687 None] Detach volume completed successfully. Sep 01 02:08:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4936fed7-e774-4f29-a9d7-384c68ee4ad7 tempest-VolumesActionsTest-1616439687 None] Lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-981dee1a-dafb-43df-a015-aaa8de55fd14 tempest-GroupSnapshotsTest-51692752 None] Group tempest-GroupSnapshotsTest-Group-1763248070: creating Sep 01 02:08:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-981dee1a-dafb-43df-a015-aaa8de55fd14 tempest-GroupSnapshotsTest-51692752 None] Group tempest-GroupSnapshotsTest-Group-1763248070: created successfully Sep 01 02:08:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-981dee1a-dafb-43df-a015-aaa8de55fd14 tempest-GroupSnapshotsTest-51692752 None] Create group completed successfully. Sep 01 02:08:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:21 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f076ca-c639-413c-bb28-4e1b668a2c9c]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:22 devstack sudo[94454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 Sep 01 02:08:22 devstack sudo[94454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:22 devstack sudo[94454]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" returned: 0 in 0.449s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb3fb38-f66c-450e-882f-6d457de0262d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:22 devstack sudo[94459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 Sep 01 02:08:22 devstack sudo[94459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Flow 'volume_create_manager' (a328cc29-fdd5-43b0-9bc9-b13ec07c40c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9216b093-dacb-44ba-97ba-dea5fd7f6c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9216b093-dacb-44ba-97ba-dea5fd7f6c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1472685443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2229b78-7b58-43a6-a3fb-a54b1fab45ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd01ec4669f249818f4426f2c85681e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:23Z,use_quota=True,user_id='144603286fc6426a8ecc8f7580236d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435e9607-394b-40c0-8029-53b2fd41f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (435e9607-394b-40c0-8029-53b2fd41f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250e18c0-1b02-434a-b2f3-7c2327c1fc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (250e18c0-1b02-434a-b2f3-7c2327c1fc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2229b78-7b58-43a6-a3fb-a54b1fab45ca', 'volume_name': 'volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67323163-699b-46d4-8089-19a384988457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67323163-699b-46d4-8089-19a384988457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b42f659-1451-4748-bb25-9844b93c01e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:22 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Volume a2229b78-7b58-43a6-a3fb-a54b1fab45ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca', 'volume_size': 1} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:22 devstack sudo[94459]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" returned: 0 in 0.501s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.495d0ee4-0b34-4d75-b75d-7658ac89c448wm9gwlos.img {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:22 devstack sudo[94464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.495d0ee4-0b34-4d75-b75d-7658ac89c448wm9gwlos.img Sep 01 02:08:22 devstack sudo[94464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Flow 'volume_create_manager' (039a815a-1119-4a23-a105-52db4f81c49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb0ec06-02b0-4003-b6ff-1c226f0a575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb0ec06-02b0-4003-b6ff-1c226f0a575b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1629811342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b75084dd-031d-482d-87bb-a5cc38897638,host='devstack@QuobyteHD#QuobyteHD',id=162123de-5bae-4f88-8c72-0b832001720d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7b790f78064a5aac8ce230cb80a02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:24Z,use_quota=True,user_id='7bc6e3b33c384fdeb7166e750dd0bb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6496fea6-7476-4a30-ba7a-5934dad80135),volume_type_id=6496fea6-7476-4a30-ba7a-5934dad80135)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb7cd9a-394b-4f1b-ab14-ad04c3b4ccfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb7cd9a-394b-4f1b-ab14-ad04c3b4ccfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2d5348-aa40-420a-8186-b8200c268269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d2d5348-aa40-420a-8186-b8200c268269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '162123de-5bae-4f88-8c72-0b832001720d', 'volume_name': 'volume-162123de-5bae-4f88-8c72-0b832001720d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afee0b6-2397-4fbd-8453-70a7c01d0ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8afee0b6-2397-4fbd-8453-70a7c01d0ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1aa9dfa-39fe-4937-be70-996c79cacdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:23 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Volume 162123de-5bae-4f88-8c72-0b832001720d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-162123de-5bae-4f88-8c72-0b832001720d', 'volume_size': 1} Sep 01 02:08:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Flow 'volume_create_manager' (ca3b36b1-a240-430f-aecb-ad62588495d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e0926f-669d-4556-b07c-ffdf3cf24691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e0926f-669d-4556-b07c-ffdf3cf24691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-810019319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4644a711-4ebf-4588-9d86-972515556b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0db5523fa43218bec1983c6bad68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:25Z,use_quota=True,user_id='0e361038554f4db687bdffda06c71f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5539c5b-217c-4836-b184-06e95b761be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5539c5b-217c-4836-b184-06e95b761be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb699ab-b5ac-49ef-b32c-315a8ab7900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeb699ab-b5ac-49ef-b32c-315a8ab7900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4644a711-4ebf-4588-9d86-972515556b12', 'volume_name': 'volume-4644a711-4ebf-4588-9d86-972515556b12', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829802a8-d181-4625-ac77-c5515918daa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829802a8-d181-4625-ac77-c5515918daa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188a2ab2-e556-407a-abcc-6fc54197ddcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:24 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Volume 4644a711-4ebf-4588-9d86-972515556b12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4644a711-4ebf-4588-9d86-972515556b12', 'volume_size': 1} Sep 01 02:08:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:27 devstack sudo[94464]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.495d0ee4-0b34-4d75-b75d-7658ac89c448wm9gwlos.img" returned: 0 in 4.972s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:27 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f562b5-5c79-4160-a0ea-9bfc1cfeb90e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:27 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 Sep 01 02:08:27 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:28 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" returned: 0 in 0.572s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:28 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8, size 1024.00 MB, duration 4.97 sec, destination /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.495d0ee4-0b34-4d75-b75d-7658ac89c448wm9gwlos.img {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:08:28 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] Converted 1024.00 MB image at 205.92 MB/s Sep 01 02:08:28 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] 495d0ee4-0b34-4d75-b75d-7658ac89c448 was raw, no need to convert to raw {{(pid=87389) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 02:08:34 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=16,cinder:UPDATE=17,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:08:38 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=23,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:47 devstack sudo[94498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:08:47 devstack sudo[94498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:47 devstack sudo[94498]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.276s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:08:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.650s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] Uploaded volume to glance image-id: 495d0ee4-0b34-4d75-b75d-7658ac89c448. {{(pid=87389) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.681s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1472685443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2229b78-7b58-43a6-a3fb-a54b1fab45ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd01ec4669f249818f4426f2c85681e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:23Z,use_quota=True,user_id='144603286fc6426a8ecc8f7580236d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Creating volume a2229b78-7b58-43a6-a3fb-a54b1fab45ca {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:48 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:48 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca 1073741824 Sep 01 02:08:48 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bf608c03-7822-48c1-be68-3216285d2952 tempest-VolumesActionsTest-1616439687 None] Copy volume to image completed successfully. Sep 01 02:08:48 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca 1073741824" returned: 0 in 0.433s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:49 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca Sep 01 02:08:49 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:49 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.347s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b75084dd-031d-482d-87bb-a5cc38897638,created_at=2026-09-01T00:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1629811342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b75084dd-031d-482d-87bb-a5cc38897638,host='devstack@QuobyteHD#QuobyteHD',id=162123de-5bae-4f88-8c72-0b832001720d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7b790f78064a5aac8ce230cb80a02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:24Z,use_quota=True,user_id='7bc6e3b33c384fdeb7166e750dd0bb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6496fea6-7476-4a30-ba7a-5934dad80135),volume_type_id=6496fea6-7476-4a30-ba7a-5934dad80135)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Creating volume 162123de-5bae-4f88-8c72-0b832001720d {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:49 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b42f659-1451-4748-bb25-9844b93c01e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:49 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d 1073741824 Sep 01 02:08:49 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3149620-e32d-4cff-96d0-47b217b9fdf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:49 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Volume volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca (a2229b78-7b58-43a6-a3fb-a54b1fab45ca): created successfully Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3149620-e32d-4cff-96d0-47b217b9fdf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Flow 'volume_create_manager' (a328cc29-fdd5-43b0-9bc9-b13ec07c40c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:49 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-cc6645da-c5d1-4870-98f3-c9b7f8ecceed tempest-AttachVolumeTestJSON-1480235634 None] Created volume successfully. Sep 01 02:08:49 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d 1073741824" returned: 0 in 0.567s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:49 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d Sep 01 02:08:49 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:50 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d" returned: 0 in 0.298s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.320s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:08:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-810019319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4644a711-4ebf-4588-9d86-972515556b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e0db5523fa43218bec1983c6bad68f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:08:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:08:25Z,use_quota=True,user_id='0e361038554f4db687bdffda06c71f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Creating volume 4644a711-4ebf-4588-9d86-972515556b12 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:08:50 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1aa9dfa-39fe-4937-be70-996c79cacdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162123de-5bae-4f88-8c72-0b832001720d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:50 devstack sudo[94527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12 1073741824 Sep 01 02:08:50 devstack sudo[94527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1c1bfe-fee4-4131-be6d-d650195d81ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:50 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Volume volume-162123de-5bae-4f88-8c72-0b832001720d (162123de-5bae-4f88-8c72-0b832001720d): created successfully Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b1c1bfe-fee4-4131-be6d-d650195d81ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Flow 'volume_create_manager' (039a815a-1119-4a23-a105-52db4f81c49b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:50 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-70f43673-5d0f-4e6c-ae05-79748562094d tempest-GroupSnapshotsTest-51692752 None] Created volume successfully. Sep 01 02:08:50 devstack sudo[94527]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12 1073741824" returned: 0 in 0.490s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:50 devstack sudo[94537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12 Sep 01 02:08:50 devstack sudo[94537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:51 devstack sudo[94537]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12" returned: 0 in 0.269s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.931s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188a2ab2-e556-407a-abcc-6fc54197ddcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4644a711-4ebf-4588-9d86-972515556b12', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eced2570-e9f9-4e9f-b07b-d598d52676cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[974b0eae-6c10-42ca-a698-9237988f2d1b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:51 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Volume volume-4644a711-4ebf-4588-9d86-972515556b12 (4644a711-4ebf-4588-9d86-972515556b12): created successfully Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eced2570-e9f9-4e9f-b07b-d598d52676cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Flow 'volume_create_manager' (ca3b36b1-a240-430f-aecb-ad62588495d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:08:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-749ff3ac-2a6a-4478-ab58-4fbb242d0fc0 tempest-VolumesServicesTestJSON-1747723785 None] Created volume successfully. Sep 01 02:08:51 devstack sudo[94540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 Sep 01 02:08:51 devstack sudo[94540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-ab389054-afc2-45ef-8039-569507314ea9 req-71a01705-04f4-4970-b0f7-5890ba9d91ee tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:51 devstack sudo[94540]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" returned: 0 in 0.429s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4888ed9-3841-4906-870b-b6f0bd1380fc]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] GroupSnapshot 5566bf43-9a8b-4b03-a170-568524204a29: creating. Sep 01 02:08:51 devstack sudo[94554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 Sep 01 02:08:51 devstack sudo[94554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] Group snapshot 5566bf43-9a8b-4b03-a170-568524204a29: creating. {{(pid=87389) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Acquiring lock "cinder-4644a711-4ebf-4588-9d86-972515556b12-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Lock "cinder-4644a711-4ebf-4588-9d86-972515556b12-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Acquiring lock "cinder-quobyte-4644a711-4ebf-4588-9d86-972515556b12" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Lock "cinder-quobyte-4644a711-4ebf-4588-9d86-972515556b12" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:08:51 devstack sudo[94554]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" returned: 0 in 0.414s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a13997-40e1-48a8-825c-e45bfa68bfc9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:51 devstack sudo[94559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img Sep 01 02:08:51 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:52 devstack sudo[94560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12 Sep 01 02:08:52 devstack sudo[94560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:52 devstack sudo[94560]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12" returned: 0 in 0.494s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:52 devstack sudo[94576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12 Sep 01 02:08:52 devstack sudo[94576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:53 devstack sudo[94576]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4644a711-4ebf-4588-9d86-972515556b12" returned: 0 in 0.630s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Lock "cinder-quobyte-4644a711-4ebf-4588-9d86-972515556b12" released by "delete_volume" :: held 1.208s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:53 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Created reservations ['f9156951-2fa2-4718-92c7-9cb827bc9d4f', 'def4e581-36ee-4c8b-bec8-7149aaadec72', '98662978-e3d6-456e-a800-81d02dd9636b', 'f6cc1bf2-e388-411e-9a80-91ba13ade7c6'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:08:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:08:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:08:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:08:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:08:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:08:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:53 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:08:53 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:54 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.602s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:54 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:08:54 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Deleted volume successfully. Sep 01 02:08:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ff48968f-dfb9-4e5d-a738-a9998f25aa01 tempest-VolumesServicesTestJSON-1747723785 None] Lock "cinder-4644a711-4ebf-4588-9d86-972515556b12-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:08:57 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img" returned: 0 in 5.252s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:57 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7722db5-7166-4810-986f-f974d23a2ad7]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:57 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 Sep 01 02:08:57 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:57 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" returned: 0 in 0.646s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:57 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8, size 1024.00 MB, duration 5.26 sec, destination /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:08:57 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Converted 1024.00 MB image at 194.83 MB/s Sep 01 02:08:57 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] 173443b0-a4fb-4d9f-a78d-f3fec5052b9b was raw, converting to qcow2 {{(pid=87389) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 01 02:08:57 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2921bbd4-7ac2-4b96-82cf-785b4e3f6b31]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:58 devstack sudo[94591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img Sep 01 02:08:58 devstack sudo[94591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:58 devstack sudo[94591]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img" returned: 0 in 0.356s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:58 devstack sudo[94595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img Sep 01 02:08:58 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:58 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img" returned: 1 in 0.338s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:08:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img /opt/stack/data/cinder/conversion/vol_upload_oix6yl1z {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:58 devstack sudo[94600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img /opt/stack/data/cinder/conversion/vol_upload_oix6yl1z Sep 01 02:08:58 devstack sudo[94600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:58 devstack sudo[94600]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img /opt/stack/data/cinder/conversion/vol_upload_oix6yl1z" returned: 0 in 0.280s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:08:58 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Image conversion details: src /opt/stack/data/cinder/conversion/fc42c1ff-37c8-4eb7-89a0-3078c17de4c8.temp_image.173443b0-a4fb-4d9f-a78d-f3fec5052b9byxe4uq9m.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_oix6yl1z {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:08:58 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 01 02:08:58 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[800bd5db-c50d-41e4-a081-cc3be15b2bed]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:08:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oix6yl1z {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:08:58 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oix6yl1z Sep 01 02:08:58 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:08:59 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Sep 01 02:08:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_oix6yl1z" returned: 0 in 0.355s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.757s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Uploaded volume to glance image-id: 173443b0-a4fb-4d9f-a78d-f3fec5052b9b. {{(pid=87389) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:09:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-ab389054-afc2-45ef-8039-569507314ea9 req-71a01705-04f4-4970-b0f7-5890ba9d91ee tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.439s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-ab389054-afc2-45ef-8039-569507314ea9 req-71a01705-04f4-4970-b0f7-5890ba9d91ee tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.179s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a233729b-5533-4e8c-a965-2466ce200abd tempest-VolumesActionsTest-1616439687 None] Copy volume to image completed successfully. Sep 01 02:09:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] Creating offline snapshot c11758a3-58fb-4b55-8eb2-8a7e56ce404e of volume 162123de-5bae-4f88-8c72-0b832001720d {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-ab389054-afc2-45ef-8039-569507314ea9 req-71a01705-04f4-4970-b0f7-5890ba9d91ee tempest-AttachVolumeTestJSON-1480235634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a0205da-5e55-4412-8070-76e232432225', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:09:00 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c95641-5710-4324-a281-b07f14f63d12]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-ab389054-afc2-45ef-8039-569507314ea9 req-71a01705-04f4-4970-b0f7-5890ba9d91ee tempest-AttachVolumeTestJSON-1480235634 None] attachment_update completed successfully. Sep 01 02:09:01 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d Sep 01 02:09:01 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:01 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d" returned: 0 in 0.473s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:01 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e 1G Sep 01 02:09:01 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:01 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e 1G" returned: 0 in 0.498s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-162123de-5bae-4f88-8c72-0b832001720d -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:01 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-162123de-5bae-4f88-8c72-0b832001720d -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e Sep 01 02:09:01 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:02 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-162123de-5bae-4f88-8c72-0b832001720d -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e" returned: 0 in 0.386s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:02 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:09:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:02 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e Sep 01 02:09:02 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:02 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e" returned: 0 in 0.407s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Acquiring lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:02 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.info Sep 01 02:09:02 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Acquiring lock "cinder-quobyte-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Lock "cinder-quobyte-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" acquired by "delete_volume" :: waited 0.031s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:02 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e3a35a-8bb9-4c45-9600-cc7b916a3a85]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:03 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 Sep 01 02:09:03 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:03 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.info" returned: 0 in 0.443s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:03 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:03 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.info Sep 01 02:09:03 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:03 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" returned: 0 in 0.552s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:03 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:03 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8 Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.info" returned: 0 in 0.342s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:03 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.747s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:03 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-efb198b5-0df8-4c6e-b433-47e9ce51c938 tempest-GroupSnapshotsTest-51692752 None] group_snapshot 5566bf43-9a8b-4b03-a170-568524204a29: created successfully Sep 01 02:09:03 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" returned: 0 in 0.301s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Lock "cinder-quobyte-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8" released by "delete_volume" :: held 0.907s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Created reservations ['7904678c-e76b-49e8-b254-a67f7f44d290', '19bbe58e-572b-4001-929d-357a4d9d9536', '29ae4e82-3e8d-42ed-bd5c-286c55f811aa', '05da0b5a-8035-42b0-b55f-53a75f7968f0'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:04 devstack sudo[95033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:09:04 devstack sudo[95033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:04 devstack sudo[95033]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.314s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:04 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:04 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Deleted volume successfully. Sep 01 02:09:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a2af9892-340e-400d-8351-accecd8ecffb tempest-VolumesActionsTest-1616439687 None] Lock "cinder-fc42c1ff-37c8-4eb7-89a0-3078c17de4c8-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-c11758a3-58fb-4b55-8eb2-8a7e56ce404e-4f9a9ec3-f618-4f62-be02-e4b896c13583" by "_create_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-c11758a3-58fb-4b55-8eb2-8a7e56ce404e-4f9a9ec3-f618-4f62-be02-e4b896c13583" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Creating volume 4f9a9ec3-f618-4f62-be02-e4b896c13583 from snapshot c11758a3-58fb-4b55-8eb2-8a7e56ce404e {{(pid=87389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-4f9a9ec3-f618-4f62-be02-e4b896c13583" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-4f9a9ec3-f618-4f62-be02-e4b896c13583" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] snapshot: c11758a3-58fb-4b55-8eb2-8a7e56ce404e, volume: 4f9a9ec3-f618-4f62-be02-e4b896c13583, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdfb906-91a6-4f72-b2a9-ba53caffbef7]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:05 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e Sep 01 02:09:05 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:06 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e" returned: 0 in 0.716s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-162123de-5bae-4f88-8c72-0b832001720d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:06 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4435f051-69ac-4879-b205-217de923a3a9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:06 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d Sep 01 02:09:06 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:07 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d" returned: 0 in 0.655s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:09:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:09:07 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583 not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:09:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:07 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583 Sep 01 02:09:07 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583" returned: 0 in 8.040s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:15 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d, size 1024.00 MB, duration 8.04 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583 {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:09:15 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Converted 1024.00 MB image at 127.34 MB/s Sep 01 02:09:15 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:09:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:15 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583 Sep 01 02:09:15 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:15 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583" returned: 0 in 0.296s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-4f9a9ec3-f618-4f62-be02-e4b896c13583" released by "_copy_volume_from_snapshot" :: held 9.832s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-c11758a3-58fb-4b55-8eb2-8a7e56ce404e-4f9a9ec3-f618-4f62-be02-e4b896c13583" released by "_create_volume_from_snapshot" :: held 9.920s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.942s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:15 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5414c6c5-061d-4407-bf14-e56b96aaf6b1 tempest-GroupSnapshotsTest-51692752 None] Create group from source-snapshot-5566bf43-9a8b-4b03-a170-568524204a29 completed successfully. Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Flow 'volume_create_manager' (0c357dfc-c38a-4336-b4b5-877d015db69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839431b3-524a-4c43-9907-da1cd4a0ab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839431b3-524a-4c43-9907-da1cd4a0ab42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1239683077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40008a13-ce55-4192-be8a-d36f6e244dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e5875d322c4da9875aab375e656dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:16Z,use_quota=True,user_id='ba5675812e6a4741b245b546c05afd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcee79f6-4e00-4583-96cd-a0a318e8d8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcee79f6-4e00-4583-96cd-a0a318e8d8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91238cdc-8828-4601-9e42-9efd896f3793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91238cdc-8828-4601-9e42-9efd896f3793) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40008a13-ce55-4192-be8a-d36f6e244dc5', 'volume_name': 'volume-40008a13-ce55-4192-be8a-d36f6e244dc5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d8e94d-e457-4072-94f4-d3b646533df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74d8e94d-e457-4072-94f4-d3b646533df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61e6d82-176d-4748-9368-77b4820613c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:16 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Volume 40008a13-ce55-4192-be8a-d36f6e244dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40008a13-ce55-4192-be8a-d36f6e244dc5', 'volume_size': 1} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1239683077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40008a13-ce55-4192-be8a-d36f6e244dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e5875d322c4da9875aab375e656dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:16Z,use_quota=True,user_id='ba5675812e6a4741b245b546c05afd1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Creating volume 40008a13-ce55-4192-be8a-d36f6e244dc5 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:16 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:09:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:16 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5 1073741824 Sep 01 02:09:16 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-4f9a9ec3-f618-4f62-be02-e4b896c13583" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-4f9a9ec3-f618-4f62-be02-e4b896c13583" acquired by "delete_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7298e5e4-2848-43c3-8aba-afebfa6778e7]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:17 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5 1073741824" returned: 0 in 0.592s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:17 devstack sudo[95584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5 Sep 01 02:09:17 devstack sudo[95584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:17 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583 Sep 01 02:09:17 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:17 devstack sudo[95584]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5" returned: 0 in 0.365s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61e6d82-176d-4748-9368-77b4820613c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40008a13-ce55-4192-be8a-d36f6e244dc5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cf2ec4-269e-4419-8ebe-12a9e1607851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:17 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583" returned: 0 in 0.557s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:17 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Volume volume-40008a13-ce55-4192-be8a-d36f6e244dc5 (40008a13-ce55-4192-be8a-d36f6e244dc5): created successfully Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24cf2ec4-269e-4419-8ebe-12a9e1607851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Flow 'volume_create_manager' (0c357dfc-c38a-4336-b4b5-877d015db69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:17 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583 Sep 01 02:09:17 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:17 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5ba0617f-0da3-4a02-83b5-9d553455d1a6 tempest-VolumesMetadataTest-565612973 None] Created volume successfully. Sep 01 02:09:18 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4f9a9ec3-f618-4f62-be02-e4b896c13583" returned: 0 in 0.349s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-4f9a9ec3-f618-4f62-be02-e4b896c13583" released by "delete_volume" :: held 0.971s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Created reservations ['fa259a2f-8784-494b-a326-96a280ed6548'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:18 devstack cinder-volume[87389]: WARNING cinder.quota [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-854690067 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-854690067, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:09:18 devstack cinder-volume[87389]: WARNING cinder.quota [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-854690067 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-854690067, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Created reservations ['f59bfb98-ff7b-46e6-a49c-423add85ecfe', '6be347fd-2c02-4795-b41f-1f0428b73a05', '47437314-5cf4-45bd-8edc-8e34f1efe1aa', 'f112ab7c-6e22-4e43-9121-9beb712ce0a5'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:18 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:09:18 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:18 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] group_snapshot 5566bf43-9a8b-4b03-a170-568524204a29: deleting Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] group_snapshot 5566bf43-9a8b-4b03-a170-568524204a29: deleting {{(pid=87389) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-162123de-5bae-4f88-8c72-0b832001720d" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-162123de-5bae-4f88-8c72-0b832001720d" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-c11758a3-58fb-4b55-8eb2-8a7e56ce404e" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-c11758a3-58fb-4b55-8eb2-8a7e56ce404e" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Deleting offline snapshot c11758a3-58fb-4b55-8eb2-8a7e56ce404e of volume 162123de-5bae-4f88-8c72-0b832001720d {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] snapshot_file for this snap is: volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:18 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.471s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf0ec3d-f342-4589-9a21-c3bd8158af6b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5785f74b-3ae6-4a67-88cd-9c091e8edd15 tempest-GroupSnapshotsTest-51692752 None] Delete group completed successfully. Sep 01 02:09:19 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e Sep 01 02:09:19 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:19 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e" returned: 0 in 0.608s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-162123de-5bae-4f88-8c72-0b832001720d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:19 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d703593c-afa1-4808-9b47-180d6aca4595]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:19 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d Sep 01 02:09:19 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Acquiring lock "cinder-40008a13-ce55-4192-be8a-d36f6e244dc5-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Lock "cinder-40008a13-ce55-4192-be8a-d36f6e244dc5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Acquiring lock "cinder-quobyte-40008a13-ce55-4192-be8a-d36f6e244dc5" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Lock "cinder-quobyte-40008a13-ce55-4192-be8a-d36f6e244dc5" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:20 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[caea56b5-4bfb-4ef4-96b2-1cf334a0648d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:20 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5 Sep 01 02:09:20 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:20 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d" returned: 0 in 0.792s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:20 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e Sep 01 02:09:20 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:20 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5" returned: 0 in 0.575s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:20 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5 Sep 01 02:09:20 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:20 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e" returned: 0 in 0.512s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:20 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e Sep 01 02:09:20 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:21 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-40008a13-ce55-4192-be8a-d36f6e244dc5" returned: 0 in 0.444s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Lock "cinder-quobyte-40008a13-ce55-4192-be8a-d36f6e244dc5" released by "delete_volume" :: held 1.095s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Created reservations ['286023eb-2634-42f7-a649-26c312b9c958', 'a4983055-af93-4771-884c-fffb0a89a09b', '32495bc7-0be4-4fd6-b017-16df950820bb', '7cdfafbb-a0dd-4d84-8b9e-e5b5bafaf619'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:21 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d.c11758a3-58fb-4b55-8eb2-8a7e56ce404e" returned: 0 in 0.429s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:21 devstack sudo[95663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:09:21 devstack sudo[95663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-c11758a3-58fb-4b55-8eb2-8a7e56ce404e" released by "_delete_snapshot" :: held 2.512s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-162123de-5bae-4f88-8c72-0b832001720d" released by "delete_snapshot" :: held 2.566s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:21 devstack cinder-volume[87389]: WARNING cinder.quota [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-854690067 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-854690067, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] Created reservations ['606de6b2-0446-449f-abad-b5aacbbc5e12', 'd7a11c38-d4f0-4bfa-b5da-899b3a8a0f86', '85953271-5f12-4d4a-b493-312ccd8ac816', '4d88a040-4d83-4ed8-97ee-ac6e470fac20'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0160d0d4-541e-41bb-b403-9ff831f2cacb tempest-GroupSnapshotsTest-51692752 None] group_snapshot 5566bf43-9a8b-4b03-a170-568524204a29: deleted successfully Sep 01 02:09:21 devstack sudo[95663]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.417s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Deleted volume successfully. Sep 01 02:09:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c880ddd6-23d2-428f-b434-c1da2ae9ef67 tempest-VolumesMetadataTest-565612973 None] Lock "cinder-40008a13-ce55-4192-be8a-d36f6e244dc5-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Flow 'volume_create_manager' (760b1bcc-91aa-4946-8524-586101a973d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5862b5-cc65-4edc-bcb4-b9b8751153c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b5862b5-cc65-4edc-bcb4-b9b8751153c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-795662286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b240052b-d966-4cea-a5a4-92dcb24f6750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ea5215b9af4456b590ca148cf49607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:22Z,use_quota=True,user_id='f24c43141ddb453989b6d76e9d024a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd40310-5463-40f8-8ca5-c7fbf8e2280f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd40310-5463-40f8-8ca5-c7fbf8e2280f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a81da2a-a42d-4670-8d3c-dfa04f477bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a81da2a-a42d-4670-8d3c-dfa04f477bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b240052b-d966-4cea-a5a4-92dcb24f6750', 'volume_name': 'volume-b240052b-d966-4cea-a5a4-92dcb24f6750', 'volume_size': 2}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8518c03-cb9f-4a0d-ae9d-227b5203b6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8518c03-cb9f-4a0d-ae9d-227b5203b6d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc1192e-a0a9-4b6f-a03e-97f315e7d31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:22 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Volume b240052b-d966-4cea-a5a4-92dcb24f6750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b240052b-d966-4cea-a5a4-92dcb24f6750', 'volume_size': 2} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-795662286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b240052b-d966-4cea-a5a4-92dcb24f6750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6ea5215b9af4456b590ca148cf49607',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:22Z,use_quota=True,user_id='f24c43141ddb453989b6d76e9d024a45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Creating volume b240052b-d966-4cea-a5a4-92dcb24f6750 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:22 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750 2147483648 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:22 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750 2147483648 Sep 01 02:09:22 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-162123de-5bae-4f88-8c72-0b832001720d" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:22 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750 2147483648" returned: 0 in 0.627s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-162123de-5bae-4f88-8c72-0b832001720d" acquired by "delete_volume" :: waited 0.039s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5883fa6-36d4-4132-b0c5-7ecf933957f4]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:22 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750 Sep 01 02:09:22 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:23 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d Sep 01 02:09:23 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:23 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750" returned: 0 in 0.412s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc1192e-a0a9-4b6f-a03e-97f315e7d31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b240052b-d966-4cea-a5a4-92dcb24f6750', 'volume_size': 2}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff01d3a4-1e08-4ebf-92cc-3da543dc780f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:23 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Volume volume-b240052b-d966-4cea-a5a4-92dcb24f6750 (b240052b-d966-4cea-a5a4-92dcb24f6750): created successfully Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff01d3a4-1e08-4ebf-92cc-3da543dc780f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Flow 'volume_create_manager' (760b1bcc-91aa-4946-8524-586101a973d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:23 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5dec5b55-411d-4cb5-b1ab-1874fc631789 tempest-VolumesCloneNegativeTest-1452005438 None] Created volume successfully. Sep 01 02:09:23 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d" returned: 0 in 0.547s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:23 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d Sep 01 02:09:23 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:23 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-162123de-5bae-4f88-8c72-0b832001720d" returned: 0 in 0.294s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-162123de-5bae-4f88-8c72-0b832001720d" released by "delete_volume" :: held 0.924s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Created reservations ['8665ee4d-5e3f-4a5a-96c9-1dce70a911b7'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:23 devstack cinder-volume[87389]: WARNING cinder.db.api [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-854690067'] Sep 01 02:09:23 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Created reservations ['c09a0aaf-2523-4286-b7e9-0c135fcdc72b', '8c93b435-8761-4d12-bd60-92823ac21f87', 'a9e142b8-3756-41e9-9824-7bc725a85dde', '9a6e46b0-92b5-446d-a0e8-dc7b1330f847'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:24 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:09:24 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:24 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.364s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:24 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-cfbcb803-dd4f-4533-8ee5-ea356b725698 tempest-GroupSnapshotsTest-51692752 None] Delete group completed successfully. Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Acquiring lock "cinder-b240052b-d966-4cea-a5a4-92dcb24f6750-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Lock "cinder-b240052b-d966-4cea-a5a4-92dcb24f6750-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Acquiring lock "cinder-quobyte-b240052b-d966-4cea-a5a4-92dcb24f6750" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Lock "cinder-quobyte-b240052b-d966-4cea-a5a4-92dcb24f6750" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d953b3e-fbf3-41b9-a723-35b7ec722c19]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:24 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750 Sep 01 02:09:24 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:24 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750" returned: 0 in 0.373s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:24 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750 Sep 01 02:09:24 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:25 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b240052b-d966-4cea-a5a4-92dcb24f6750" returned: 0 in 0.257s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Lock "cinder-quobyte-b240052b-d966-4cea-a5a4-92dcb24f6750" released by "delete_volume" :: held 0.676s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Created reservations ['a4236ab0-8959-4390-9be0-6e8bd2e9b63b', '7a6862db-e5f0-4fd0-be51-2b72d4fb44d1', '336bc881-4a49-4c1a-8f33-cd575de55d47', 'c5c885cd-fe24-4344-a6f4-3cd3f2735e19'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:25 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:09:25 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ec8283db-a8e9-4d60-a937-8327efe69fe2 tempest-GroupSnapshotsTest-51692752 None] Group tempest-GroupSnapshotsTest-Group-1949578896: creating Sep 01 02:09:25 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.346s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ec8283db-a8e9-4d60-a937-8327efe69fe2 tempest-GroupSnapshotsTest-51692752 None] Group tempest-GroupSnapshotsTest-Group-1949578896: created successfully Sep 01 02:09:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Deleted volume successfully. Sep 01 02:09:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ec8283db-a8e9-4d60-a937-8327efe69fe2 tempest-GroupSnapshotsTest-51692752 None] Create group completed successfully. Sep 01 02:09:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b2906f1-8e0d-4fd7-a3a9-1ee863294d29 tempest-VolumesCloneNegativeTest-1452005438 None] Lock "cinder-b240052b-d966-4cea-a5a4-92dcb24f6750-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Flow 'volume_create_manager' (6553e3ed-b725-4410-8671-4f2a3e621f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5da1522-db6d-422c-a27e-e1262c90735f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5da1522-db6d-422c-a27e-e1262c90735f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504807295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4641c2fc-231a-4e4b-a7e9-04eb7f0c8578,host='devstack@QuobyteHD#QuobyteHD',id=5fbedfbb-dda5-48b4-ab73-30e32e746d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7b790f78064a5aac8ce230cb80a02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:27Z,use_quota=True,user_id='7bc6e3b33c384fdeb7166e750dd0bb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bded3571-c065-404e-8604-26f7d7b597dd),volume_type_id=bded3571-c065-404e-8604-26f7d7b597dd)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c66d947-597b-44cc-88d9-26716e52bedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c66d947-597b-44cc-88d9-26716e52bedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2142451b-55e2-410b-b825-7c53dd69506d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2142451b-55e2-410b-b825-7c53dd69506d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fbedfbb-dda5-48b4-ab73-30e32e746d64', 'volume_name': 'volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d76e6e-c059-411d-879b-730d85e0d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d76e6e-c059-411d-879b-730d85e0d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff66aaea-3b5e-468f-aa7a-3a0319c997f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Volume 5fbedfbb-dda5-48b4-ab73-30e32e746d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64', 'volume_size': 1} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4641c2fc-231a-4e4b-a7e9-04eb7f0c8578,created_at=2026-09-01T00:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1504807295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4641c2fc-231a-4e4b-a7e9-04eb7f0c8578,host='devstack@QuobyteHD#QuobyteHD',id=5fbedfbb-dda5-48b4-ab73-30e32e746d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7b790f78064a5aac8ce230cb80a02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:27Z,use_quota=True,user_id='7bc6e3b33c384fdeb7166e750dd0bb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bded3571-c065-404e-8604-26f7d7b597dd),volume_type_id=bded3571-c065-404e-8604-26f7d7b597dd)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Creating volume 5fbedfbb-dda5-48b4-ab73-30e32e746d64 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:27 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:27 devstack sudo[95731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 1073741824 Sep 01 02:09:27 devstack sudo[95731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Flow 'volume_create_manager' (079d6c7a-6863-456f-a046-160da2094589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6456a43a-6406-4ca9-8728-b6168360d55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6456a43a-6406-4ca9-8728-b6168360d55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1399833232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fc109d-41fa-4121-975a-d1501e8783e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ca7a93f404412bb7f57ed8dc45f7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:28Z,use_quota=True,user_id='ed5f1653e88e46309f2d77ae4d000729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d50db3-5a28-453b-9bd1-abccac057371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35d50db3-5a28-453b-9bd1-abccac057371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ab698d-195f-44d4-916b-5acde4757a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ab698d-195f-44d4-916b-5acde4757a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82fc109d-41fa-4121-975a-d1501e8783e5', 'volume_name': 'volume-82fc109d-41fa-4121-975a-d1501e8783e5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c074d0cd-9c91-4c35-bbcc-eb6d79ba4eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c074d0cd-9c91-4c35-bbcc-eb6d79ba4eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1368aed-3ea7-499e-a410-d1f51abe92d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:27 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Volume 82fc109d-41fa-4121-975a-d1501e8783e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82fc109d-41fa-4121-975a-d1501e8783e5', 'volume_size': 1} Sep 01 02:09:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:28 devstack sudo[95731]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 1073741824" returned: 0 in 0.492s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:28 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 Sep 01 02:09:28 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64" returned: 0 in 0.259s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.575s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1399833232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fc109d-41fa-4121-975a-d1501e8783e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ca7a93f404412bb7f57ed8dc45f7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:28Z,use_quota=True,user_id='ed5f1653e88e46309f2d77ae4d000729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Creating volume 82fc109d-41fa-4121-975a-d1501e8783e5 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:28 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff66aaea-3b5e-468f-aa7a-3a0319c997f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:28 devstack sudo[95740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5 1073741824 Sep 01 02:09:28 devstack sudo[95740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd00667-1883-4d08-b3d9-76f980e5ea9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:28 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Volume volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 (5fbedfbb-dda5-48b4-ab73-30e32e746d64): created successfully Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd00667-1883-4d08-b3d9-76f980e5ea9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Flow 'volume_create_manager' (6553e3ed-b725-4410-8671-4f2a3e621f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:28 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7d01b37c-bf64-4948-83c2-5d5b93566d6b tempest-GroupSnapshotsTest-51692752 None] Created volume successfully. Sep 01 02:09:28 devstack sudo[95740]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5 1073741824" returned: 0 in 0.539s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5 Sep 01 02:09:29 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5" returned: 0 in 0.304s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1368aed-3ea7-499e-a410-d1f51abe92d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82fc109d-41fa-4121-975a-d1501e8783e5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3601480-59da-4633-9f29-e305ca19cf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Volume volume-82fc109d-41fa-4121-975a-d1501e8783e5 (82fc109d-41fa-4121-975a-d1501e8783e5): created successfully Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3601480-59da-4633-9f29-e305ca19cf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Flow 'volume_create_manager' (079d6c7a-6863-456f-a046-160da2094589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:29 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-53e03cfa-63d1-4db0-958e-207db7ef6d3b tempest-VolumesTransfersV355Test-1625795963 None] Created volume successfully. Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Flow 'volume_create_manager' (d7ebafc1-13c2-4eee-8c13-6c18821fb916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5401111a-7453-4a5c-bc42-9e7a5733fc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5401111a-7453-4a5c-bc42-9e7a5733fc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-278856214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2da673d-8176-45ea-807e-4432794e9741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3569b0ab85e845719afbb72ff0859223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:29Z,use_quota=True,user_id='4c7f3608854a4aca9d3ae62336865868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c8a19a-293d-47d4-896c-f8b043967108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14c8a19a-293d-47d4-896c-f8b043967108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbe048c-1071-4c18-b28d-7b6bc88a805f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbbe048c-1071-4c18-b28d-7b6bc88a805f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2da673d-8176-45ea-807e-4432794e9741', 'volume_name': 'volume-d2da673d-8176-45ea-807e-4432794e9741', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb91719d-752d-4c33-a4c8-d328717d332d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb91719d-752d-4c33-a4c8-d328717d332d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec498de8-1db5-499b-9e78-3702f66fcc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Volume d2da673d-8176-45ea-807e-4432794e9741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2da673d-8176-45ea-807e-4432794e9741', 'volume_size': 1} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-278856214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2da673d-8176-45ea-807e-4432794e9741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3569b0ab85e845719afbb72ff0859223',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:29Z,use_quota=True,user_id='4c7f3608854a4aca9d3ae62336865868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Creating volume d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:29 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:29 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 1073741824 Sep 01 02:09:29 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Flow 'volume_create_manager' (0e871757-81ee-4a62-8ac4-91810eec4bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cd43c6-5943-4c5b-b139-b273ddcbb350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cd43c6-5943-4c5b-b139-b273ddcbb350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-589242045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4641c2fc-231a-4e4b-a7e9-04eb7f0c8578,host='devstack@QuobyteHD#QuobyteHD',id=61e82528-dcf1-4e7e-97d5-4d052c50d3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7b790f78064a5aac8ce230cb80a02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:30Z,use_quota=True,user_id='7bc6e3b33c384fdeb7166e750dd0bb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bded3571-c065-404e-8604-26f7d7b597dd),volume_type_id=bded3571-c065-404e-8604-26f7d7b597dd)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df4d4d2-95b3-404c-b26e-a0b91e02795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df4d4d2-95b3-404c-b26e-a0b91e02795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6376b5-6446-416a-ac67-07949293a34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6376b5-6446-416a-ac67-07949293a34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e82528-dcf1-4e7e-97d5-4d052c50d3bf', 'volume_name': 'volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be8ca48-f7ba-4d96-8665-b033055805d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2be8ca48-f7ba-4d96-8665-b033055805d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6743596-75f9-4487-b6f4-c29d4aea9e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:29 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Volume 61e82528-dcf1-4e7e-97d5-4d052c50d3bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf', 'volume_size': 1} Sep 01 02:09:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:30 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 1073741824" returned: 0 in 0.477s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:30 devstack sudo[95756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 Sep 01 02:09:30 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:30 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741" returned: 0 in 0.280s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4641c2fc-231a-4e4b-a7e9-04eb7f0c8578,created_at=2026-09-01T00:09:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-589242045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4641c2fc-231a-4e4b-a7e9-04eb7f0c8578,host='devstack@QuobyteHD#QuobyteHD',id=61e82528-dcf1-4e7e-97d5-4d052c50d3bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7b790f78064a5aac8ce230cb80a02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:30Z,use_quota=True,user_id='7bc6e3b33c384fdeb7166e750dd0bb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bded3571-c065-404e-8604-26f7d7b597dd),volume_type_id=bded3571-c065-404e-8604-26f7d7b597dd)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Creating volume 61e82528-dcf1-4e7e-97d5-4d052c50d3bf {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:30 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec498de8-1db5-499b-9e78-3702f66fcc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2da673d-8176-45ea-807e-4432794e9741', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:30 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf 1073741824 Sep 01 02:09:30 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb22c650-052e-4a6d-8284-3cd2b5212e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:30 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Volume volume-d2da673d-8176-45ea-807e-4432794e9741 (d2da673d-8176-45ea-807e-4432794e9741): created successfully Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb22c650-052e-4a6d-8284-3cd2b5212e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Flow 'volume_create_manager' (d7ebafc1-13c2-4eee-8c13-6c18821fb916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:30 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1d71b12d-ded2-4543-add0-aa221829f225 tempest-VolumesSnapshotListTestJSON-1531042954 None] Created volume successfully. Sep 01 02:09:30 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-272f873c-c95d-40c6-8ae2-01b590dc7fe3 tempest-VolumesTransfersV355Test-783246894 None] Transfer volume completed successfully. Sep 01 02:09:30 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf 1073741824" returned: 0 in 0.480s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf Sep 01 02:09:31 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Acquiring lock "cinder-82fc109d-41fa-4121-975a-d1501e8783e5-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf" returned: 0 in 0.259s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6743596-75f9-4487-b6f4-c29d4aea9e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82620493-ca4c-4fb7-a6fc-ff429dc08983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Lock "cinder-82fc109d-41fa-4121-975a-d1501e8783e5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:31 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Volume volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf (61e82528-dcf1-4e7e-97d5-4d052c50d3bf): created successfully Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82620493-ca4c-4fb7-a6fc-ff429dc08983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Flow 'volume_create_manager' (0e871757-81ee-4a62-8ac4-91810eec4bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:31 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8230028e-0238-42f1-8280-fd8f4a7eda14 tempest-GroupSnapshotsTest-51692752 None] Created volume successfully. Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Acquiring lock "cinder-quobyte-82fc109d-41fa-4121-975a-d1501e8783e5" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Lock "cinder-quobyte-82fc109d-41fa-4121-975a-d1501e8783e5" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d03e9be-a78b-4397-a37f-81ac58034ca9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5 Sep 01 02:09:31 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Creating offline snapshot d67ddbde-4d03-4de0-89e8-9f7b7da8b21d of volume d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e77e7dc-71b1-4043-8048-7ae5c5432eef]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5" returned: 0 in 0.503s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:31 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5 Sep 01 02:09:31 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:31 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 Sep 01 02:09:31 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-71ddc19d-576f-4a81-81c7-0e20d24c5eff tempest-GroupSnapshotsTest-51692752 None] Update group completed successfully. Sep 01 02:09:32 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82fc109d-41fa-4121-975a-d1501e8783e5" returned: 0 in 0.360s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Lock "cinder-quobyte-82fc109d-41fa-4121-975a-d1501e8783e5" released by "delete_volume" :: held 0.904s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:32 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741" returned: 0 in 0.513s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Created reservations ['3ae4dea4-e690-430d-85ba-b604df666d15', 'ce7686ca-e50d-46ba-a5f2-002b6e6200e4', '931aa79d-c102-48ad-a7f6-bf14a47bd64e', '1a093ca7-86a3-4fe3-a442-95efebdb94d2'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:32 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d 1G Sep 01 02:09:32 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:32 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:09:32 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:32 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.325s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:32 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Deleted volume successfully. Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37808f0b-f670-4945-a15f-a70f879705e5 tempest-VolumesTransfersV355Test-2143519390 None] Lock "cinder-82fc109d-41fa-4121-975a-d1501e8783e5-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:32 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d 1G" returned: 0 in 0.546s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2da673d-8176-45ea-807e-4432794e9741 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:32 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2da673d-8176-45ea-807e-4432794e9741 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d Sep 01 02:09:32 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:33 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2da673d-8176-45ea-807e-4432794e9741 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d" returned: 0 in 0.303s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:33 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d is being set with open permissions: ugo+rw Sep 01 02:09:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:33 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d Sep 01 02:09:33 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:33 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-aa4b49f5-e3dc-43da-ab1e-fbe9babd8150 tempest-GroupSnapshotsTest-51692752 None] Update group completed successfully. Sep 01 02:09:33 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d" returned: 0 in 0.266s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:33 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.info Sep 01 02:09:33 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:33 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.info" returned: 0 in 0.269s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:33 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.info is being set with open permissions: ugo+rw Sep 01 02:09:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:33 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.info Sep 01 02:09:33 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:34 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.info" returned: 0 in 0.285s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.313s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Flow 'volume_create_manager' (d0d555cf-f80d-48bf-8f06-a32d4802703e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0237bcae-85ba-40fe-99eb-47021c78f52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:34 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b091ca0c-73b3-4725-991a-624b8d34eef9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Create snapshot completed successfully Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0237bcae-85ba-40fe-99eb-47021c78f52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-693819277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928752fb-ae20-44be-963e-0cddddee820f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ca7a93f404412bb7f57ed8dc45f7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:34Z,use_quota=True,user_id='ed5f1653e88e46309f2d77ae4d000729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2588f5-025e-4640-999c-c66cd5b4ac6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2588f5-025e-4640-999c-c66cd5b4ac6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff55751c-1a2c-4abb-a279-370989a8122a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff55751c-1a2c-4abb-a279-370989a8122a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928752fb-ae20-44be-963e-0cddddee820f', 'volume_name': 'volume-928752fb-ae20-44be-963e-0cddddee820f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d59e86-4d13-43b3-aef0-f09d707b3f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39d59e86-4d13-43b3-aef0-f09d707b3f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da92cfe5-86b3-4b57-bc24-5f4e9fdbdcd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:34 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Volume 928752fb-ae20-44be-963e-0cddddee820f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928752fb-ae20-44be-963e-0cddddee820f', 'volume_size': 1} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-693819277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928752fb-ae20-44be-963e-0cddddee820f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ca7a93f404412bb7f57ed8dc45f7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:34Z,use_quota=True,user_id='ed5f1653e88e46309f2d77ae4d000729',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Creating volume 928752fb-ae20-44be-963e-0cddddee820f {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:34 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:34 devstack sudo[95805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f 1073741824 Sep 01 02:09:34 devstack sudo[95805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:34 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3e261b4c-f150-4e46-b183-05d12b290311 tempest-GroupSnapshotsTest-51692752 None] Update group completed successfully. Sep 01 02:09:34 devstack sudo[95805]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f 1073741824" returned: 0 in 0.429s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:34 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f Sep 01 02:09:34 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:34 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f" returned: 0 in 0.253s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da92cfe5-86b3-4b57-bc24-5f4e9fdbdcd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928752fb-ae20-44be-963e-0cddddee820f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aef46d-96dd-4058-8877-d4f254587665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:34 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Volume volume-928752fb-ae20-44be-963e-0cddddee820f (928752fb-ae20-44be-963e-0cddddee820f): created successfully Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aef46d-96dd-4058-8877-d4f254587665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Flow 'volume_create_manager' (d0d555cf-f80d-48bf-8f06-a32d4802703e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:34 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9dbfbfc5-4eed-4485-9398-2e50e8c3c081 tempest-VolumesTransfersV355Test-1625795963 None] Created volume successfully. Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] Creating offline snapshot 1f64bac8-e459-46e2-886f-948c719f66eb of volume d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dba7db-1ebe-4867-a0cc-42a4aa6b2c1c]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:35 devstack sudo[95816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d Sep 01 02:09:35 devstack sudo[95816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Acquiring lock "cinder-928752fb-ae20-44be-963e-0cddddee820f-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Lock "cinder-928752fb-ae20-44be-963e-0cddddee820f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Acquiring lock "cinder-quobyte-928752fb-ae20-44be-963e-0cddddee820f" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Lock "cinder-quobyte-928752fb-ae20-44be-963e-0cddddee820f" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed93d161-9164-494b-a9bc-c66ba484b84c]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:35 devstack sudo[95816]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d" returned: 0 in 0.489s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2da673d-8176-45ea-807e-4432794e9741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:35 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb 1G Sep 01 02:09:35 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:35 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-f430a79a-b366-444a-b4ec-056f2bf2d68f req-8fecb9da-7a02-409f-a4d7-15cba717b0cf tempest-AttachVolumeTestJSON-1480235634 None] Terminate volume connection completed successfully. Sep 01 02:09:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-f430a79a-b366-444a-b4ec-056f2bf2d68f req-8fecb9da-7a02-409f-a4d7-15cba717b0cf tempest-AttachVolumeTestJSON-1480235634 None] Deleting attachment 5a0205da-5e55-4412-8070-76e232432225. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:09:35 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e682fa03-a29d-4709-9488-f09ac43561a4 tempest-GroupSnapshotsTest-51692752 None] Update group completed successfully. Sep 01 02:09:35 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f Sep 01 02:09:35 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:36 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f" returned: 0 in 0.426s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:36 devstack sudo[95834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f Sep 01 02:09:36 devstack sudo[95834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:36 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb 1G" returned: 0 in 0.490s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:36 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb Sep 01 02:09:36 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:36 devstack sudo[95834]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-928752fb-ae20-44be-963e-0cddddee820f" returned: 0 in 0.281s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Lock "cinder-quobyte-928752fb-ae20-44be-963e-0cddddee820f" released by "delete_volume" :: held 0.802s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Created reservations ['a3ed8443-8851-4755-b67c-7135fac8503e', '63082b34-421e-4e64-adbe-8bf61654ccc4', '452aaae1-ecb2-4834-bc45-b35f02a7a3ab', '46d012e3-2b40-4fae-aebb-a5b6cf1a5c72'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:36 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb" returned: 0 in 0.366s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:36 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb is being set with open permissions: ugo+rw Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:36 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb Sep 01 02:09:36 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:36 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:09:36 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:36 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb" returned: 0 in 0.408s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.942s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:37 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:37 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-592248ed-48ad-433d-bc2b-f2d8424254c0 tempest-VolumesSnapshotListTestJSON-1531042954 None] Create snapshot completed successfully Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.444s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:37 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Deleted volume successfully. Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e89d742d-872a-4655-903e-94d627513211 tempest-VolumesTransfersV355Test-2143519390 None] Lock "cinder-928752fb-ae20-44be-963e-0cddddee820f-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Creating offline snapshot c8c696a3-e28e-444b-8844-ad88b8c3049c of volume d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0643d6d5-bf5e-4ab8-852c-9015d4d2618a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:37 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] GroupSnapshot 4b11da51-60f5-4ba0-8b34-36ab6aee4581: creating. Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Group snapshot 4b11da51-60f5-4ba0-8b34-36ab6aee4581: creating. {{(pid=87389) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:37 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb Sep 01 02:09:37 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:37 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb" returned: 0 in 0.468s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2da673d-8176-45ea-807e-4432794e9741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:38 devstack sudo[95858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c 1G Sep 01 02:09:38 devstack sudo[95858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:38 devstack sudo[95858]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c 1G" returned: 0 in 0.792s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:38 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c Sep 01 02:09:38 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:39 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c" returned: 0 in 0.407s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:39 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c is being set with open permissions: ugo+rw Sep 01 02:09:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:39 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c Sep 01 02:09:39 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:39 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c" returned: 0 in 0.327s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:39 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=111,cinder:UPDATE=121,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:09:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.220s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.042s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Creating offline snapshot ab38b63d-ff01-470c-960d-3e28cf548102 of volume 5fbedfbb-dda5-48b4-ab73-30e32e746d64 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:39 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeca2152-1fab-4b66-a940-336de408c148]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fae627d7-c558-4cca-ac17-cc61476553f9 tempest-VolumesSnapshotListTestJSON-1531042954 None] Create snapshot completed successfully Sep 01 02:09:39 devstack sudo[95888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 Sep 01 02:09:39 devstack sudo[95888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:40 devstack sudo[95888]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64" returned: 0 in 0.530s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:40 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 1G Sep 01 02:09:40 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:41 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 1G" returned: 0 in 0.756s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:41 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 Sep 01 02:09:41 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:41 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102" returned: 0 in 0.558s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:41 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:09:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:41 devstack sudo[95974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 Sep 01 02:09:41 devstack sudo[95974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "cinder-c8c696a3-e28e-444b-8844-ad88b8c3049c-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-c8c696a3-e28e-444b-8844-ad88b8c3049c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "cinder-quobyte-c8c696a3-e28e-444b-8844-ad88b8c3049c" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:42 devstack sudo[95974]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102" returned: 0 in 0.570s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-c8c696a3-e28e-444b-8844-ad88b8c3049c" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Deleting offline snapshot c8c696a3-e28e-444b-8844-ad88b8c3049c of volume d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] snapshot_file for this snap is: volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f8487b-7a4d-4e46-8157-ac96b1c41664]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:42 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.info Sep 01 02:09:42 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:42 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c Sep 01 02:09:42 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:42 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.info" returned: 0 in 0.487s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:42 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:42 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c" returned: 0 in 0.552s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2da673d-8176-45ea-807e-4432794e9741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:42 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.info Sep 01 02:09:42 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf6056e-5729-4dbd-87f1-110182fc463f]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:43 devstack sudo[95997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb Sep 01 02:09:43 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.info" returned: 0 in 0.370s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.529s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Creating offline snapshot dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba of volume 61e82528-dcf1-4e7e-97d5-4d052c50d3bf {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d47e88-69d8-4308-b171-82a454feda99]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack sudo[96001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf Sep 01 02:09:43 devstack sudo[96001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:43 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb" returned: 0 in 0.571s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2da673d-8176-45ea-807e-4432794e9741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c Sep 01 02:09:43 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:43 devstack sudo[96001]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf" returned: 0 in 0.501s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:43 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba 1G Sep 01 02:09:43 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c" returned: 0 in 0.714s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c Sep 01 02:09:44 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba 1G" returned: 0 in 0.620s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba Sep 01 02:09:44 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:44 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.c8c696a3-e28e-444b-8844-ad88b8c3049c" returned: 0 in 0.396s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-c8c696a3-e28e-444b-8844-ad88b8c3049c" released by "_delete_snapshot" :: held 2.416s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" released by "delete_snapshot" :: held 2.468s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Created reservations ['9b910ee5-9a1b-4911-a551-5d33d398c42e', 'c62bd93e-9b5f-427d-9735-236bf837f71b', 'f91b8292-bfd4-4872-b23d-5012979f4ea5', '4e018bcd-bce1-465c-9de4-7a16a3653aab'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=120,cinder:UPDATE=121,cinder:DELETE=11,cinder:INSERT=29 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:09:44 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba" returned: 0 in 0.476s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:44 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:44 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Delete snapshot completed successfully. Sep 01 02:09:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-29a30e79-eea8-4a05-8288-5f885d329004 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-c8c696a3-e28e-444b-8844-ad88b8c3049c-delete_snapshot" released by "delete_snapshot" :: held 2.772s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:44 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba Sep 01 02:09:44 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba" returned: 0 in 0.316s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.info Sep 01 02:09:45 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "cinder-1f64bac8-e459-46e2-886f-948c719f66eb-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-1f64bac8-e459-46e2-886f-948c719f66eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "cinder-quobyte-1f64bac8-e459-46e2-886f-948c719f66eb" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-1f64bac8-e459-46e2-886f-948c719f66eb" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Deleting offline snapshot 1f64bac8-e459-46e2-886f-948c719f66eb of volume d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:45 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] snapshot_file for this snap is: volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.info" returned: 0 in 0.318s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4620ab55-69a7-4a6a-85af-8559869b8b3b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:45 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.info Sep 01 02:09:45 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb Sep 01 02:09:45 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:45 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.info" returned: 0 in 0.323s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.676s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:46 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb" returned: 0 in 0.530s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2da673d-8176-45ea-807e-4432794e9741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:46 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bfdd13a9-3741-4e25-bfa2-90601c157ec4 tempest-GroupSnapshotsTest-51692752 None] group_snapshot 4b11da51-60f5-4ba0-8b34-36ab6aee4581: created successfully Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56b347a-8d89-452f-a2a9-c77111a2f5d9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:46 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d Sep 01 02:09:46 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:46 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] group_snapshot 4b11da51-60f5-4ba0-8b34-36ab6aee4581: deleting Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Flow 'volume_create_manager' (9e7a18cf-3a75-4b88-a24f-7da9b48945b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed87c977-702a-44fa-8f2f-a614331629eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed87c977-702a-44fa-8f2f-a614331629eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1538916095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9284bf-fb4b-42e4-a238-569d8372ff0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d67ede8abd0b4be38be4ca61cc8ce70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:46Z,use_quota=True,user_id='fa522a69757342df934cbc6631b17e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05cfe11e-ecd5-4e67-b969-64de6c7e3129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05cfe11e-ecd5-4e67-b969-64de6c7e3129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cb1ca7-1856-45f6-980f-b995ad7a00ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27cb1ca7-1856-45f6-980f-b995ad7a00ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b9284bf-fb4b-42e4-a238-569d8372ff0f', 'volume_name': 'volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a08a07-d8df-46d8-bc5f-af1e1fca5338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a08a07-d8df-46d8-bc5f-af1e1fca5338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:46 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bc6899-bf3e-4d08-93af-9c36854ca4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:46 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Volume 1b9284bf-fb4b-42e4-a238-569d8372ff0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f', 'volume_size': 1} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1538916095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b9284bf-fb4b-42e4-a238-569d8372ff0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d67ede8abd0b4be38be4ca61cc8ce70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:46Z,use_quota=True,user_id='fa522a69757342df934cbc6631b17e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Creating volume 1b9284bf-fb4b-42e4-a238-569d8372ff0f {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:46 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:46 devstack sudo[96051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f 1073741824 Sep 01 02:09:46 devstack sudo[96051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d" returned: 0 in 0.529s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2da673d-8176-45ea-807e-4432794e9741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] group_snapshot 4b11da51-60f5-4ba0-8b34-36ab6aee4581: deleting {{(pid=87389) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:09:46 devstack sudo[96053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb Sep 01 02:09:46 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-5fbedfbb-dda5-48b4-ab73-30e32e746d64" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-5fbedfbb-dda5-48b4-ab73-30e32e746d64" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-ab38b63d-ff01-470c-960d-3e28cf548102" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-ab38b63d-ff01-470c-960d-3e28cf548102" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Deleting offline snapshot ab38b63d-ff01-470c-960d-3e28cf548102 of volume 5fbedfbb-dda5-48b4-ab73-30e32e746d64 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] snapshot_file for this snap is: volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddc1c02-5ae1-4c2b-b49a-7add089ab220]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:47 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 Sep 01 02:09:47 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:47 devstack sudo[96051]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f 1073741824" returned: 0 in 0.506s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb" returned: 0 in 0.492s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:47 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb Sep 01 02:09:47 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:47 devstack sudo[96067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f Sep 01 02:09:47 devstack sudo[96067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:47 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:09:47 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:47 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102" returned: 0 in 0.512s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1060df1-7f54-4686-a3cf-d97bb74b5050]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:47 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.1f64bac8-e459-46e2-886f-948c719f66eb" returned: 0 in 0.324s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack sudo[96067]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-1f64bac8-e459-46e2-886f-948c719f66eb" released by "_delete_snapshot" :: held 2.073s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f" returned: 0 in 0.380s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" released by "delete_snapshot" :: held 2.118s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6bc6899-bf3e-4d08-93af-9c36854ca4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:47 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 Sep 01 02:09:47 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a51627c-cf3b-4e0c-a60b-2f8ce5499bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:47 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Volume volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f (1b9284bf-fb4b-42e4-a238-569d8372ff0f): created successfully Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a51627c-cf3b-4e0c-a60b-2f8ce5499bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Flow 'volume_create_manager' (9e7a18cf-3a75-4b88-a24f-7da9b48945b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:47 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6b8f9156-7631-4081-a543-239f118b4eff tempest-VolumesListTestJSON-1774944879 None] Created volume successfully. Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Created reservations ['8dbc3c40-b7bc-44ee-a978-edaf0b4ea458', '95a5d7e9-c313-4cb2-9f4a-b0a84a1c0585', 'c30eb0e2-1a15-41a6-93a4-3e95d00edbfd', '34d074f0-7487-459f-886e-244b205b6c34'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:47 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.431s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:09:47 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Delete snapshot completed successfully. Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9df47ba9-1c58-4e1e-b4be-ce1760b2dbcb tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-1f64bac8-e459-46e2-886f-948c719f66eb-delete_snapshot" released by "delete_snapshot" :: held 2.372s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:47 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64" returned: 0 in 0.485s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:47 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 Sep 01 02:09:47 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:48 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102" returned: 0 in 0.343s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:48 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102 Sep 01 02:09:48 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:48 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64.ab38b63d-ff01-470c-960d-3e28cf548102" returned: 0 in 0.271s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-ab38b63d-ff01-470c-960d-3e28cf548102" released by "_delete_snapshot" :: held 1.804s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-5fbedfbb-dda5-48b4-ab73-30e32e746d64" released by "delete_snapshot" :: held 1.842s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-61e82528-dcf1-4e7e-97d5-4d052c50d3bf" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-61e82528-dcf1-4e7e-97d5-4d052c50d3bf" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Deleting offline snapshot dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba of volume 61e82528-dcf1-4e7e-97d5-4d052c50d3bf {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] snapshot_file for this snap is: volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "cinder-d67ddbde-4d03-4de0-89e8-9f7b7da8b21d-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff944510-597a-45b2-9857-232c9a74d221]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-d67ddbde-4d03-4de0-89e8-9f7b7da8b21d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "cinder-quobyte-d67ddbde-4d03-4de0-89e8-9f7b7da8b21d" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-d67ddbde-4d03-4de0-89e8-9f7b7da8b21d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Deleting offline snapshot d67ddbde-4d03-4de0-89e8-9f7b7da8b21d of volume d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] snapshot_file for this snap is: volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb7c2a-8c58-4724-81e4-bfcce5e4aa9b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:48 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba Sep 01 02:09:48 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:49 devstack sudo[96092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d Sep 01 02:09:49 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:49 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba" returned: 0 in 0.666s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc261f70-4093-484f-b1fa-972de2aa594b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Flow 'volume_create_manager' (14bed7e0-e4ad-4b18-aef7-4afc4ec449e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:49 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33457899-5a7f-4207-815e-2f93f671af75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d" returned: 0 in 0.744s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2da673d-8176-45ea-807e-4432794e9741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33457899-5a7f-4207-815e-2f93f671af75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1438128182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d4f08e-c895-477c-92fb-48a2d44dc530,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d67ede8abd0b4be38be4ca61cc8ce70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:49Z,use_quota=True,user_id='fa522a69757342df934cbc6631b17e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:49 devstack sudo[96103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf Sep 01 02:09:49 devstack sudo[96103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb1dd3f-a094-4c71-8b26-3b10691048b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb1dd3f-a094-4c71-8b26-3b10691048b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e949b591-f67b-4109-a9a3-3d1cb93c346c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e949b591-f67b-4109-a9a3-3d1cb93c346c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d4f08e-c895-477c-92fb-48a2d44dc530', 'volume_name': 'volume-a1d4f08e-c895-477c-92fb-48a2d44dc530', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b18656-1e0a-46e6-99a6-888682a0cb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b18656-1e0a-46e6-99a6-888682a0cb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3874aa-61d0-4112-bd2c-7b79e2ad561d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:49 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Volume a1d4f08e-c895-477c-92fb-48a2d44dc530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d4f08e-c895-477c-92fb-48a2d44dc530', 'volume_size': 1} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1438128182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d4f08e-c895-477c-92fb-48a2d44dc530,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d67ede8abd0b4be38be4ca61cc8ce70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:49Z,use_quota=True,user_id='fa522a69757342df934cbc6631b17e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Creating volume a1d4f08e-c895-477c-92fb-48a2d44dc530 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:49 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[39dfc921-270f-44e3-8fa9-97b71595162e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:49 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530 1073741824 Sep 01 02:09:49 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:49 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 Sep 01 02:09:49 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:50 devstack sudo[96103]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf" returned: 0 in 0.733s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:50 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba Sep 01 02:09:50 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:50 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741" returned: 0 in 0.661s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:50 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d Sep 01 02:09:50 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:50 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530 1073741824" returned: 0 in 0.740s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:50 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530 Sep 01 02:09:50 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:50 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba" returned: 0 in 0.506s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:50 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba Sep 01 02:09:50 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:50 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530" returned: 0 in 0.337s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:50 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d" returned: 0 in 0.484s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a3874aa-61d0-4112-bd2c-7b79e2ad561d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d4f08e-c895-477c-92fb-48a2d44dc530', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:50 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d Sep 01 02:09:50 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ce1a45-b3e8-4ebc-ad80-6f314c4c1451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:50 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Volume volume-a1d4f08e-c895-477c-92fb-48a2d44dc530 (a1d4f08e-c895-477c-92fb-48a2d44dc530): created successfully Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ce1a45-b3e8-4ebc-ad80-6f314c4c1451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Flow 'volume_create_manager' (14bed7e0-e4ad-4b18-aef7-4afc4ec449e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:50 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8cb4b66e-f2fc-424c-9c2d-c30f01524ac8 tempest-VolumesListTestJSON-1774944879 None] Created volume successfully. Sep 01 02:09:51 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf.dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba" returned: 0 in 0.359s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-dc56ce95-cc5c-49e4-8dcd-c9af4f1b6dba" released by "_delete_snapshot" :: held 2.417s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-61e82528-dcf1-4e7e-97d5-4d052c50d3bf" released by "delete_snapshot" :: held 2.451s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:51 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:51 devstack cinder-volume[87389]: WARNING cinder.quota [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1252840552 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1252840552, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:09:51 devstack cinder-volume[87389]: WARNING cinder.quota [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1252840552 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1252840552, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:09:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741.d67ddbde-4d03-4de0-89e8-9f7b7da8b21d" returned: 0 in 0.384s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:51 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Created reservations ['e724bcb1-6815-4cb1-98cf-abf687a58d0c', '6972a2f6-3cc9-4335-85cf-68d26235d828', '5320a662-e908-490f-aa27-54e24095e4c2', '34021af9-b043-499a-acb5-d461609f5fbe'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-d67ddbde-4d03-4de0-89e8-9f7b7da8b21d" released by "_delete_snapshot" :: held 2.493s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" released by "delete_snapshot" :: held 2.531s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:51 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Created reservations ['e9e2bb45-b394-4164-8bcd-5116da0f9f7b', '9ab5dbd2-5959-4b42-a38d-238bc6824d71', '397d8486-972f-4373-8b27-f8260f78780f', '7de4fbb3-6763-4673-894f-a47080214cd1'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:51 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] Created reservations ['0e1f421c-c768-4d7f-a5ab-574176781a9a', 'c6eafa04-6590-4e77-a2e0-7b20d4713401', 'c2d976f4-11b1-45ed-ab06-59068129d4ad', '9ea4db78-112d-4aec-98eb-1777f789c81f'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Delete snapshot completed successfully. Sep 01 02:09:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4bfcabdc-a8be-43ca-88f9-3ba26e3e0217 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-d67ddbde-4d03-4de0-89e8-9f7b7da8b21d-delete_snapshot" released by "delete_snapshot" :: held 2.808s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2bad6e43-934f-42e8-9d2f-de65bf71d370 tempest-GroupSnapshotsTest-51692752 None] group_snapshot 4b11da51-60f5-4ba0-8b34-36ab6aee4581: deleted successfully Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "cinder-d2da673d-8176-45ea-807e-4432794e9741-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-d2da673d-8176-45ea-807e-4432794e9741-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae4525d-5f23-4f12-8e9b-068284857d53]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Flow 'volume_create_manager' (21b853a3-52a5-4e17-98bd-3b917a162ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:52 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 Sep 01 02:09:52 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdee9e9-03f8-45a3-863d-a1af1dd04aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cdee9e9-03f8-45a3-863d-a1af1dd04aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1776686592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8068f3c-e5fc-49d2-aa54-527675870e3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d67ede8abd0b4be38be4ca61cc8ce70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:52Z,use_quota=True,user_id='fa522a69757342df934cbc6631b17e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f932516-a7c0-46e1-a4c4-de9bafd285bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f932516-a7c0-46e1-a4c4-de9bafd285bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744ff6a2-d5c2-4e95-a5fb-32b1e09c0eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744ff6a2-d5c2-4e95-a5fb-32b1e09c0eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8068f3c-e5fc-49d2-aa54-527675870e3d', 'volume_name': 'volume-d8068f3c-e5fc-49d2-aa54-527675870e3d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa34375-16ae-49d2-b64e-a9fd44e66e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa34375-16ae-49d2-b64e-a9fd44e66e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d45d13c-ee81-4099-b254-27ff82149214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:52 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Volume d8068f3c-e5fc-49d2-aa54-527675870e3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8068f3c-e5fc-49d2-aa54-527675870e3d', 'volume_size': 1} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1776686592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8068f3c-e5fc-49d2-aa54-527675870e3d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d67ede8abd0b4be38be4ca61cc8ce70a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:52Z,use_quota=True,user_id='fa522a69757342df934cbc6631b17e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Creating volume d8068f3c-e5fc-49d2-aa54-527675870e3d {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:52 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:52 devstack sudo[96152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d 1073741824 Sep 01 02:09:52 devstack sudo[96152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-5fbedfbb-dda5-48b4-ab73-30e32e746d64" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:52 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-5fbedfbb-dda5-48b4-ab73-30e32e746d64" acquired by "delete_volume" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741" returned: 0 in 0.585s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54ed285-b755-456d-8f0a-1f683986b1cb]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:52 devstack sudo[96159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741 Sep 01 02:09:52 devstack sudo[96159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:53 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 Sep 01 02:09:53 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:53 devstack sudo[96152]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d 1073741824" returned: 0 in 0.657s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:53 devstack sudo[96159]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2da673d-8176-45ea-807e-4432794e9741" returned: 0 in 0.417s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:53 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d Sep 01 02:09:53 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-quobyte-d2da673d-8176-45ea-807e-4432794e9741" released by "delete_volume" :: held 1.103s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Created reservations ['5a6554e9-4607-49b2-a00a-dee5e33b5474', 'c77735ac-333d-4ea5-85ee-ae1ed3e26823', 'e26dff44-ac5f-4d5b-84e7-ed63e52f6b8b', 'a1e7e2a8-7a79-4733-bebd-568fa7ac0914'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:53 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64" returned: 0 in 0.616s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:53 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:09:53 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64 Sep 01 02:09:53 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:53 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:53 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d" returned: 0 in 0.420s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d45d13c-ee81-4099-b254-27ff82149214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8068f3c-e5fc-49d2-aa54-527675870e3d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799dac22-1984-4ee3-bfaf-eeb21e1e4500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:53 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Volume volume-d8068f3c-e5fc-49d2-aa54-527675870e3d (d8068f3c-e5fc-49d2-aa54-527675870e3d): created successfully Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799dac22-1984-4ee3-bfaf-eeb21e1e4500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Flow 'volume_create_manager' (21b853a3-52a5-4e17-98bd-3b917a162ed4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-67942446-2796-4242-8bda-09d71aa82374 tempest-VolumesListTestJSON-1774944879 None] Created volume successfully. Sep 01 02:09:53 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.305s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:53 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5fbedfbb-dda5-48b4-ab73-30e32e746d64" returned: 0 in 0.311s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Deleted volume successfully. Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-5fbedfbb-dda5-48b4-ab73-30e32e746d64" released by "delete_volume" :: held 1.015s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-61e82528-dcf1-4e7e-97d5-4d052c50d3bf" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-61e82528-dcf1-4e7e-97d5-4d052c50d3bf" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b05c6a4c-4852-4bae-8a97-552baaab6142 tempest-VolumesSnapshotListTestJSON-1531042954 None] Lock "cinder-d2da673d-8176-45ea-807e-4432794e9741-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9222a6-408f-4017-bf8e-0268c33a5ed5]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:53 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf Sep 01 02:09:53 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:54 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf" returned: 0 in 0.402s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:54 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf Sep 01 02:09:54 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:54 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-61e82528-dcf1-4e7e-97d5-4d052c50d3bf" returned: 0 in 0.435s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-61e82528-dcf1-4e7e-97d5-4d052c50d3bf" released by "delete_volume" :: held 0.906s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:54 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Created reservations ['121a89cf-8f26-4e9e-a5ef-68550ee985f7'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:54 devstack cinder-volume[87389]: WARNING cinder.quota [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1252840552 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1252840552, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:09:54 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Created reservations ['b19c27e6-fe04-48e0-8c05-a56b93afaa12', '5d302989-a466-434c-b980-97a2f4984d37', '37c5a618-3f66-4d7c-8394-b1e54e5a2b0e', '6672ff73-9325-406b-9d94-9514acd67174'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:55 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Created reservations ['d61e2313-345e-4a25-afd5-8c3c8639e7ca', 'c13576ce-d393-4887-bee4-f2d1bef3a2a0', '91f13e39-47ce-4cbd-828d-0ff081c208da', '4fe9e38f-b5ca-4ec0-ad36-b81548ee578b'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:55 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:09:55 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:55 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.499s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:55 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:55 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bcc72a92-73b5-44a4-b5f2-fb714844a751 tempest-GroupSnapshotsTest-51692752 None] Delete group completed successfully. Sep 01 02:09:56 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9a5cf83d-ff85-4597-881b-3f57de775583 tempest-GroupSnapshotsTest-51692752 None] Group tempest-GroupSnapshotsTest-Group-20727103: creating Sep 01 02:09:56 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9a5cf83d-ff85-4597-881b-3f57de775583 tempest-GroupSnapshotsTest-51692752 None] Group tempest-GroupSnapshotsTest-Group-20727103: created successfully Sep 01 02:09:56 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9a5cf83d-ff85-4597-881b-3f57de775583 tempest-GroupSnapshotsTest-51692752 None] Create group completed successfully. Sep 01 02:09:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "cinder-d8068f3c-e5fc-49d2-aa54-527675870e3d-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-d8068f3c-e5fc-49d2-aa54-527675870e3d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "cinder-quobyte-d8068f3c-e5fc-49d2-aa54-527675870e3d" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-quobyte-d8068f3c-e5fc-49d2-aa54-527675870e3d" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf738e8a-5010-4d73-87e8-2086c6fa53df]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:57 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d Sep 01 02:09:57 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:57 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d" returned: 0 in 0.521s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:57 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d Sep 01 02:09:57 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Flow 'volume_create_manager' (3d7eed75-e246-44ad-9a43-efd4e9172af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5a8ad4-5891-4fdc-ab3f-c1ebd86abc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5a8ad4-5891-4fdc-ab3f-c1ebd86abc72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-56250558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73bd71b1-4226-41e3-9786-1c30e55ce454,host='devstack@QuobyteHD#QuobyteHD',id=1ed183b2-ce93-44f7-b171-c0123cc7e619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7b790f78064a5aac8ce230cb80a02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:58Z,use_quota=True,user_id='7bc6e3b33c384fdeb7166e750dd0bb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d2d476d-215c-4fec-8e2a-1a849bf979a5),volume_type_id=0d2d476d-215c-4fec-8e2a-1a849bf979a5)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df5b212-986a-4796-be67-60885024e167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df5b212-986a-4796-be67-60885024e167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662a41eb-7c00-47fb-8324-ff07108b5276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (662a41eb-7c00-47fb-8324-ff07108b5276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ed183b2-ce93-44f7-b171-c0123cc7e619', 'volume_name': 'volume-1ed183b2-ce93-44f7-b171-c0123cc7e619', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c88199-f906-41c5-bbb7-6af4b87efcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7c88199-f906-41c5-bbb7-6af4b87efcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77096de-728b-415d-b2d5-360292e38b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:57 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Volume 1ed183b2-ce93-44f7-b171-c0123cc7e619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ed183b2-ce93-44f7-b171-c0123cc7e619', 'volume_size': 1} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=73bd71b1-4226-41e3-9786-1c30e55ce454,created_at=2026-09-01T00:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-56250558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=73bd71b1-4226-41e3-9786-1c30e55ce454,host='devstack@QuobyteHD#QuobyteHD',id=1ed183b2-ce93-44f7-b171-c0123cc7e619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba7b790f78064a5aac8ce230cb80a02b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:09:58Z,use_quota=True,user_id='7bc6e3b33c384fdeb7166e750dd0bb26',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d2d476d-215c-4fec-8e2a-1a849bf979a5),volume_type_id=0d2d476d-215c-4fec-8e2a-1a849bf979a5)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Creating volume 1ed183b2-ce93-44f7-b171-c0123cc7e619 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:09:57 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:09:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:57 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 1073741824 Sep 01 02:09:57 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:58 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d8068f3c-e5fc-49d2-aa54-527675870e3d" returned: 0 in 0.364s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-quobyte-d8068f3c-e5fc-49d2-aa54-527675870e3d" released by "delete_volume" :: held 0.930s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Created reservations ['b9142f4d-64ca-45f3-99f9-f930aab2c7ac', 'ff21dd9d-6bba-4238-b5ba-30869da84962', 'ecd9494f-7827-4a39-8514-140337fd1f26', 'f4aeeafa-a8d5-47ef-b6a2-1f9ac75288ec'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:58 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:09:58 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:58 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.297s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:09:58 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 1073741824" returned: 0 in 0.623s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:58 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Deleted volume successfully. Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1383ac74-705f-43c8-af72-88e3aadc72eb tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-d8068f3c-e5fc-49d2-aa54-527675870e3d-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:58 devstack sudo[96208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 Sep 01 02:09:58 devstack sudo[96208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:58 devstack sudo[96208]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619" returned: 0 in 0.388s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e77096de-728b-415d-b2d5-360292e38b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ed183b2-ce93-44f7-b171-c0123cc7e619', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08d47c9-b668-4e85-b743-6e4582c0f2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:09:58 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Volume volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 (1ed183b2-ce93-44f7-b171-c0123cc7e619): created successfully Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f08d47c9-b668-4e85-b743-6e4582c0f2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:09:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Flow 'volume_create_manager' (3d7eed75-e246-44ad-9a43-efd4e9172af2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:09:59 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4286cb8e-05d7-4070-82d9-2c379a5e280e tempest-GroupSnapshotsTest-51692752 None] Created volume successfully. Sep 01 02:09:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "cinder-a1d4f08e-c895-477c-92fb-48a2d44dc530-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-a1d4f08e-c895-477c-92fb-48a2d44dc530-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "cinder-quobyte-a1d4f08e-c895-477c-92fb-48a2d44dc530" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:09:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-quobyte-a1d4f08e-c895-477c-92fb-48a2d44dc530" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:09:59 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d988db50-7e77-4aac-beb4-f4b0d4e26b11]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:09:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:59 devstack sudo[96211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530 Sep 01 02:09:59 devstack sudo[96211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:09:59 devstack sudo[96211]: pam_unix(sudo:session): session closed for user root Sep 01 02:09:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530" returned: 0 in 0.421s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:09:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:09:59 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530 Sep 01 02:09:59 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:00 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1d4f08e-c895-477c-92fb-48a2d44dc530" returned: 0 in 0.322s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-quobyte-a1d4f08e-c895-477c-92fb-48a2d44dc530" released by "delete_volume" :: held 0.783s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Created reservations ['6c7e75c1-8e21-43ac-8dfd-23dd362c7d3e', '24332cf5-1023-4488-989c-8fe9f30cb40c', '6c10dda0-db79-4c35-8e14-6c3cf1a52d94', '522226fc-06bd-41e9-89b2-e9b9b0189823'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:00 devstack sudo[96219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:10:00 devstack sudo[96219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] GroupSnapshot aca28e94-736e-4216-be4c-472fe1bdf7e4: creating. Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] Group snapshot aca28e94-736e-4216-be4c-472fe1bdf7e4: creating. {{(pid=87389) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] Creating offline snapshot fd4fd756-fec8-4f32-946e-c364d94eb95c of volume 1ed183b2-ce93-44f7-b171-c0123cc7e619 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d526354d-1ea7-44bc-8b98-52b90fb2dd55]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "cinder-1b9284bf-fb4b-42e4-a238-569d8372ff0f-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-1b9284bf-fb4b-42e4-a238-569d8372ff0f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:00 devstack sudo[96219]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.368s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "cinder-quobyte-1b9284bf-fb4b-42e4-a238-569d8372ff0f" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Deleted volume successfully. Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-quobyte-1b9284bf-fb4b-42e4-a238-569d8372ff0f" acquired by "delete_volume" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:00 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 Sep 01 02:10:00 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f4e4d8a0-deb5-42bd-906e-bd2e5e76fb51 tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-a1d4f08e-c895-477c-92fb-48a2d44dc530-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[33430f1f-5862-446e-bd27-c388d5a17045]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:00 devstack sudo[96224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f Sep 01 02:10:00 devstack sudo[96224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:01 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619" returned: 0 in 0.440s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c 1G Sep 01 02:10:01 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:01 devstack sudo[96224]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f" returned: 0 in 0.418s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f Sep 01 02:10:01 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:01 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:01 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1b9284bf-fb4b-42e4-a238-569d8372ff0f" returned: 0 in 0.326s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c 1G" returned: 0 in 0.509s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-quobyte-1b9284bf-fb4b-42e4-a238-569d8372ff0f" released by "delete_volume" :: held 0.818s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:01 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c Sep 01 02:10:01 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Created reservations ['b5724922-8016-4cc3-8f2f-eab7bde0bba5', 'd6f844a9-50d6-430a-8370-92808629f4e0', 'd619c37e-0542-486c-9fb1-8f811253f5b9', '45779a9f-0f52-4096-a3db-1df41e84fb22'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:01 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:10:01 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:02 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c" returned: 0 in 0.566s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:02 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:10:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:02 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c Sep 01 02:10:02 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:02 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.457s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:02 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:02 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Deleted volume successfully. Sep 01 02:10:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3a633b1f-1044-486a-8239-6499dfc58e92 tempest-VolumesListTestJSON-1774944879 None] Lock "cinder-1b9284bf-fb4b-42e4-a238-569d8372ff0f-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:02 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c" returned: 0 in 0.300s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:02 devstack sudo[96251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.info Sep 01 02:10:02 devstack sudo[96251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:02 devstack sudo[96251]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.info" returned: 0 in 0.285s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:02 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:10:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:02 devstack sudo[96254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.info Sep 01 02:10:02 devstack sudo[96254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:03 devstack sudo[96254]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.info" returned: 0 in 0.281s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.497s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:03 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9fb91305-10ec-4f29-a945-2300708356f4 tempest-GroupSnapshotsTest-51692752 None] group_snapshot aca28e94-736e-4216-be4c-472fe1bdf7e4: created successfully Sep 01 02:10:04 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] group_snapshot aca28e94-736e-4216-be4c-472fe1bdf7e4: deleting Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] group_snapshot aca28e94-736e-4216-be4c-472fe1bdf7e4: deleting {{(pid=87389) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-1ed183b2-ce93-44f7-b171-c0123cc7e619" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-1ed183b2-ce93-44f7-b171-c0123cc7e619" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-fd4fd756-fec8-4f32-946e-c364d94eb95c" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-fd4fd756-fec8-4f32-946e-c364d94eb95c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Deleting offline snapshot fd4fd756-fec8-4f32-946e-c364d94eb95c of volume 1ed183b2-ce93-44f7-b171-c0123cc7e619 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] snapshot_file for this snap is: volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8873d595-386e-4fce-943c-d7c547558ced]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:04 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c Sep 01 02:10:04 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:04 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c" returned: 0 in 0.518s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ed183b2-ce93-44f7-b171-c0123cc7e619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4409f5-1613-4fb1-aaae-ff1ec3a34715]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:05 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 Sep 01 02:10:05 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:05 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619" returned: 0 in 0.486s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:05 devstack sudo[96271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c Sep 01 02:10:05 devstack sudo[96271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:06 devstack sudo[96271]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c" returned: 0 in 0.616s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:06 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c Sep 01 02:10:06 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:06 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619.fd4fd756-fec8-4f32-946e-c364d94eb95c" returned: 0 in 0.499s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-fd4fd756-fec8-4f32-946e-c364d94eb95c" released by "_delete_snapshot" :: held 2.342s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-1ed183b2-ce93-44f7-b171-c0123cc7e619" released by "delete_snapshot" :: held 2.392s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Flow 'volume_create_manager' (43ac69eb-6f54-4a9e-a734-a9382f085cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699ef62d-80f6-4287-927e-6bd63847882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (699ef62d-80f6-4287-927e-6bd63847882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1846093334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e191a563798439ba1f43d34338e3561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:07Z,use_quota=True,user_id='b0073d222bd54cedb18359f3e92ddce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba55be54-3d3f-421b-b3c4-8f0a135c2ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba55be54-3d3f-421b-b3c4-8f0a135c2ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26bc54b-45f4-47f3-a6bf-99da9a775b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26bc54b-45f4-47f3-a6bf-99da9a775b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b02b6f-5b50-4d14-bf24-a2be5dbb6bef', 'volume_name': 'volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab37075-0fc8-4f23-8cd9-06e225670cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab37075-0fc8-4f23-8cd9-06e225670cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c769f9f6-a9a4-4488-a1be-d0bffa187ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:06 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Volume d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef', 'volume_size': 1} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1846093334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e191a563798439ba1f43d34338e3561',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:07Z,use_quota=True,user_id='b0073d222bd54cedb18359f3e92ddce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Creating volume d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:06 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:10:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:07 devstack sudo[96297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef 1073741824 Sep 01 02:10:07 devstack sudo[96297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:07 devstack cinder-volume[87389]: WARNING cinder.quota [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1912857461 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1912857461, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:10:07 devstack cinder-volume[87389]: WARNING cinder.quota [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1912857461 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1912857461, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:10:07 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] Created reservations ['f14eb591-fbbf-42cc-b337-8c770b56be3d', 'dd02c975-cd2e-4375-89fb-1633e6511a89', '161b2376-690c-433b-b0ca-0924032922f3', '2ca9a0ee-83ed-4177-8061-f9a49b758cfa'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:07 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-38ace3b2-2df6-4674-b441-a7f312232f66 tempest-GroupSnapshotsTest-51692752 None] group_snapshot aca28e94-736e-4216-be4c-472fe1bdf7e4: deleted successfully Sep 01 02:10:07 devstack sudo[96297]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef 1073741824" returned: 0 in 0.700s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:07 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef Sep 01 02:10:07 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:08 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef" returned: 0 in 0.450s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c769f9f6-a9a4-4488-a1be-d0bffa187ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eef85f2-0915-4c58-adf0-ddc333621366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:08 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Volume volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef (d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef): created successfully Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eef85f2-0915-4c58-adf0-ddc333621366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Flow 'volume_create_manager' (43ac69eb-6f54-4a9e-a734-a9382f085cfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "cinder-quobyte-1ed183b2-ce93-44f7-b171-c0123cc7e619" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:08 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-77f14e69-2dbf-48ef-bfb3-cf96bc8bfe09 tempest-VolumesNegativeTest-253940859 None] Created volume successfully. Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-1ed183b2-ce93-44f7-b171-c0123cc7e619" acquired by "delete_volume" :: waited 0.035s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[017f2961-4d13-4324-a9c7-83ca2391b50e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:08 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 Sep 01 02:10:08 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:08 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619" returned: 0 in 0.527s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:08 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619 Sep 01 02:10:08 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:09 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1ed183b2-ce93-44f7-b171-c0123cc7e619" returned: 0 in 0.435s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:09 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Lock "cinder-quobyte-1ed183b2-ce93-44f7-b171-c0123cc7e619" released by "delete_volume" :: held 1.071s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:09 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Created reservations ['7622e66a-4d8b-4170-acd0-f22f10c9960d'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:09 devstack cinder-volume[87389]: WARNING cinder.quota [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1912857461 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1912857461, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:10:09 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Created reservations ['e360a54f-e170-4f5f-b6f2-4d5671f8088c', '25f996cb-5b4b-40e1-b97b-0a96c08991a5', 'a5d5030f-6b45-475f-a30e-5116960b0b56', '395803f9-dd33-48bb-9757-a1184587dc39'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:09 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:10:09 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:10 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.315s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:10 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:10 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4b07a212-4418-4782-9660-b6cc723e86fa tempest-GroupSnapshotsTest-51692752 None] Delete group completed successfully. Sep 01 02:10:19 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=116,cinder:INSERT=28,cinder:SELECT=94,cinder:DELETE=5 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:19 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=97,cinder:INSERT=31,cinder:UPDATE=117,cinder:DELETE=4 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:10:35 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5ef81f9d-56ba-47fb-98bc-bb154acad0cc tempest-GroupsV314Test-1549874761 None] Group tempest-GroupsV314Test-Group-272185701: creating Sep 01 02:10:35 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5ef81f9d-56ba-47fb-98bc-bb154acad0cc tempest-GroupsV314Test-1549874761 None] Group tempest-GroupsV314Test-Group-272185701: created successfully Sep 01 02:10:35 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5ef81f9d-56ba-47fb-98bc-bb154acad0cc tempest-GroupsV314Test-1549874761 None] Create group completed successfully. Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Flow 'volume_create_manager' (38591d2b-3a4f-4f19-9b07-985f688cde2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e161fb-f6f4-4da9-88b4-fff8f5acb1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e161fb-f6f4-4da9-88b4-fff8f5acb1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-148057150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8601a185-6a03-4ac9-99a2-c2adc7bc294c,host='devstack@QuobyteHD#QuobyteHD',id=e771f3f8-7d01-4e11-8d10-766431ce8958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1faf640a98c415ea437b27290dbb273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:37Z,use_quota=True,user_id='c4c665a504104810b0fd1ba94592dd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd85d27c-0850-4ee4-bf67-add07700f00d),volume_type_id=fd85d27c-0850-4ee4-bf67-add07700f00d)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3f7955-96c1-40d4-b41f-2af8362eec7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa3f7955-96c1-40d4-b41f-2af8362eec7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9ba740-114e-42f7-95e8-07ebf3a87882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9ba740-114e-42f7-95e8-07ebf3a87882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e771f3f8-7d01-4e11-8d10-766431ce8958', 'volume_name': 'volume-e771f3f8-7d01-4e11-8d10-766431ce8958', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97694f59-709d-462e-af49-948829def2c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97694f59-709d-462e-af49-948829def2c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd453291-3605-42d6-9e98-c9465631e3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:37 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Volume e771f3f8-7d01-4e11-8d10-766431ce8958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e771f3f8-7d01-4e11-8d10-766431ce8958', 'volume_size': 1} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8601a185-6a03-4ac9-99a2-c2adc7bc294c,created_at=2026-09-01T00:10:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-148057150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8601a185-6a03-4ac9-99a2-c2adc7bc294c,host='devstack@QuobyteHD#QuobyteHD',id=e771f3f8-7d01-4e11-8d10-766431ce8958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1faf640a98c415ea437b27290dbb273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:37Z,use_quota=True,user_id='c4c665a504104810b0fd1ba94592dd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd85d27c-0850-4ee4-bf67-add07700f00d),volume_type_id=fd85d27c-0850-4ee4-bf67-add07700f00d)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Creating volume e771f3f8-7d01-4e11-8d10-766431ce8958 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:37 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:10:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:37 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 1073741824 Sep 01 02:10:37 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:38 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 1073741824" returned: 0 in 1.252s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:39 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 Sep 01 02:10:39 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:39 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958" returned: 0 in 0.628s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:10:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd453291-3605-42d6-9e98-c9465631e3cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e771f3f8-7d01-4e11-8d10-766431ce8958', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aef70d6-2276-4206-99de-5490580cc891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:39 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Volume volume-e771f3f8-7d01-4e11-8d10-766431ce8958 (e771f3f8-7d01-4e11-8d10-766431ce8958): created successfully Sep 01 02:10:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aef70d6-2276-4206-99de-5490580cc891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Flow 'volume_create_manager' (38591d2b-3a4f-4f19-9b07-985f688cde2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9fda3422-96b2-402b-8c01-8e7d586147d3 tempest-GroupsV314Test-1549874761 None] Created volume successfully. Sep 01 02:10:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:41 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Cloning volume e771f3f8-7d01-4e11-8d10-766431ce8958 to volume 08384921-f4f4-454f-a484-2e395820105a Sep 01 02:10:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Creating offline snapshot e46ec1f1-82cd-4540-b5a9-59391a246362 of volume e771f3f8-7d01-4e11-8d10-766431ce8958 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:10:41 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[624aea9f-c925-4d3c-91a9-fbb878650aea]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:42 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 Sep 01 02:10:42 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:42 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958" returned: 0 in 0.765s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:42 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 1G Sep 01 02:10:42 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:43 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 1G" returned: 0 in 0.725s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e771f3f8-7d01-4e11-8d10-766431ce8958 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:43 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e771f3f8-7d01-4e11-8d10-766431ce8958 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 Sep 01 02:10:43 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:44 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e771f3f8-7d01-4e11-8d10-766431ce8958 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362" returned: 0 in 0.815s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:44 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:10:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:44 devstack sudo[96657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 Sep 01 02:10:44 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:44 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362" returned: 0 in 0.646s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:45 devstack sudo[96697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.info Sep 01 02:10:45 devstack sudo[96697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:45 devstack sudo[96697]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.info" returned: 0 in 0.835s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:45 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.info is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:10:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:45 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.info Sep 01 02:10:45 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Acquiring lock "cinder-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Lock "cinder-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Acquiring lock "cinder-quobyte-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Lock "cinder-quobyte-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef" acquired by "delete_volume" :: waited 0.046s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be5f62b-63b8-4811-836c-85f0dc4ab812]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:46 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.info" returned: 0 in 0.402s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Acquiring lock "cinder-quobyte-08384921-f4f4-454f-a484-2e395820105a" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Lock "cinder-quobyte-08384921-f4f4-454f-a484-2e395820105a" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] snapshot: e46ec1f1-82cd-4540-b5a9-59391a246362, volume: 08384921-f4f4-454f-a484-2e395820105a, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:46 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef Sep 01 02:10:46 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6012785-6c0a-437c-a136-cd915729fc2f]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:46 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 Sep 01 02:10:46 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:47 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef" returned: 0 in 1.013s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:47 devstack sudo[96749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef Sep 01 02:10:47 devstack sudo[96749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:47 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:10:47 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:47 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362" returned: 0 in 1.150s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e771f3f8-7d01-4e11-8d10-766431ce8958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7e1e91-e27b-48f4-b1b5-bcf26de64a02]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:47 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.437s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:10:47 devstack sudo[96749]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef" returned: 0 in 0.600s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Lock "cinder-quobyte-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef" released by "delete_volume" :: held 1.678s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:47 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 Sep 01 02:10:47 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Created reservations ['3774400f-0f26-448b-a388-49330dd18da4', 'f9b84695-018a-4bce-9c0e-b8e4ef8c0dda', 'e511b0e1-c282-4515-954c-09540bb37ede', '6dda8921-72c6-4bb9-b379-b486058030b2'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:48 devstack sudo[96760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:10:48 devstack sudo[96760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:48 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958" returned: 0 in 0.719s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:10:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:10:48 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:10:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:48 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a Sep 01 02:10:48 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:48 devstack sudo[96760]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.451s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:48 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:10:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Deleted volume successfully. Sep 01 02:10:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28682d8a-ddb8-4394-b3a8-3dbc500b89a5 tempest-VolumesNegativeTest-253940859 None] Lock "cinder-d2b02b6f-5b50-4d14-bf24-a2be5dbb6bef-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:52 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Flow 'volume_create_manager' (9b757d31-ecfa-4f11-ba5e-e8333e846739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:10:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9043b839-6b8e-481f-b185-e53446d7ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9043b839-6b8e-481f-b185-e53446d7ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1567208728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dba42b1-ad4c-43f4-bb98-5df0059d071d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d518a0237d94f368e56284d996853bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:53Z,use_quota=True,user_id='d2728cb2e1924f3080f4756ef64fc097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77af0eb-d95b-410a-8d8e-e208272a7b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e77af0eb-d95b-410a-8d8e-e208272a7b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ba7ce9-e318-46ed-b081-db8e360f8c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ba7ce9-e318-46ed-b081-db8e360f8c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dba42b1-ad4c-43f4-bb98-5df0059d071d', 'volume_name': 'volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac80c47-fdca-4022-bd19-aba60e5c46ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac80c47-fdca-4022-bd19-aba60e5c46ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:10:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00e2b29-7cea-40f4-b9bc-e50180cf2332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:10:53 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Volume 3dba42b1-ad4c-43f4-bb98-5df0059d071d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d', 'volume_size': 1} Sep 01 02:10:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:56 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a" returned: 0 in 8.439s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:56 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958, size 1024.00 MB, duration 8.44 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:10:56 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Converted 1024.00 MB image at 121.33 MB/s Sep 01 02:10:56 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a is being set with open permissions: ugo+rw: NotImplementedError Sep 01 02:10:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:56 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a Sep 01 02:10:56 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:57 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a" returned: 0 in 0.342s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Lock "cinder-quobyte-08384921-f4f4-454f-a484-2e395820105a" released by "_copy_volume_from_snapshot" :: held 10.804s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Acquiring lock "cinder-quobyte-e46ec1f1-82cd-4540-b5a9-59391a246362" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Lock "cinder-quobyte-e46ec1f1-82cd-4540-b5a9-59391a246362" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Deleting offline snapshot e46ec1f1-82cd-4540-b5a9-59391a246362 of volume e771f3f8-7d01-4e11-8d10-766431ce8958 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] snapshot_file for this snap is: volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbc4e25-1aa0-4963-9621-34ed0d9e5ad8]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:57 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 Sep 01 02:10:57 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:57 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362" returned: 0 in 0.526s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e771f3f8-7d01-4e11-8d10-766431ce8958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a06511-d42a-4fe9-841f-d7d39c092aed]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:10:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:57 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 Sep 01 02:10:57 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:58 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958" returned: 0 in 0.810s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:58 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 Sep 01 02:10:58 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:59 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362" returned: 0 in 0.602s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:59 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362 Sep 01 02:10:59 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:59 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958.e46ec1f1-82cd-4540-b5a9-59391a246362" returned: 0 in 0.384s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Lock "cinder-quobyte-e46ec1f1-82cd-4540-b5a9-59391a246362" released by "_delete_snapshot" :: held 2.510s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.973s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.327s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1567208728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dba42b1-ad4c-43f4-bb98-5df0059d071d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d518a0237d94f368e56284d996853bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:10:53Z,use_quota=True,user_id='d2728cb2e1924f3080f4756ef64fc097',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Creating volume 3dba42b1-ad4c-43f4-bb98-5df0059d071d {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:10:59 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:10:59 devstack sudo[96824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d 1073741824 Sep 01 02:10:59 devstack sudo[96824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:10:59 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ef7939fe-6525-4948-a7a9-9d7893d4c192 tempest-GroupsV314Test-1549874761 None] Create group from source-group-8601a185-6a03-4ac9-99a2-c2adc7bc294c completed successfully. Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:10:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Flow 'volume_create_manager' (9cdfc820-3b21-4a05-826d-6acd049383cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb010b9-ef3a-4c43-b7f0-7390acf5941a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cb010b9-ef3a-4c43-b7f0-7390acf5941a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2102104510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1978ab9-48e1-4b6e-82af-992233ac0100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd01ec4669f249818f4426f2c85681e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:00Z,use_quota=True,user_id='144603286fc6426a8ecc8f7580236d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd837c19-48b4-4640-9669-7f22ca491fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd837c19-48b4-4640-9669-7f22ca491fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55335457-e58e-4e2b-bc7e-a9ae38502874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55335457-e58e-4e2b-bc7e-a9ae38502874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1978ab9-48e1-4b6e-82af-992233ac0100', 'volume_name': 'volume-a1978ab9-48e1-4b6e-82af-992233ac0100', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f10a72a-4832-4cc7-814a-e240f0d8e01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f10a72a-4832-4cc7-814a-e240f0d8e01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da94d08-ca2f-4b57-bbc6-52a7b3c29014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:00 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Volume a1978ab9-48e1-4b6e-82af-992233ac0100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1978ab9-48e1-4b6e-82af-992233ac0100', 'volume_size': 1} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:00 devstack sudo[96824]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d 1073741824" returned: 0 in 0.665s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:00 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d Sep 01 02:11:00 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:00 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d" returned: 0 in 0.467s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2102104510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1978ab9-48e1-4b6e-82af-992233ac0100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd01ec4669f249818f4426f2c85681e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:00Z,use_quota=True,user_id='144603286fc6426a8ecc8f7580236d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Creating volume a1978ab9-48e1-4b6e-82af-992233ac0100 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:00 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e00e2b29-7cea-40f4-b9bc-e50180cf2332) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b99e035-c21b-42bd-b693-f0c98c3307bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:00 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100 1073741824 Sep 01 02:11:00 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:00 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Volume volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d (3dba42b1-ad4c-43f4-bb98-5df0059d071d): created successfully Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b99e035-c21b-42bd-b693-f0c98c3307bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Flow 'volume_create_manager' (9b757d31-ecfa-4f11-ba5e-e8333e846739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-42b139b3-da62-4223-be02-f28909697ea5 tempest-TestMinimumBasicScenario-1029343942 None] Created volume successfully. Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Acquiring lock "cinder-quobyte-08384921-f4f4-454f-a484-2e395820105a" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Lock "cinder-quobyte-08384921-f4f4-454f-a484-2e395820105a" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3234334-0238-4100-96bf-d51b475372b4]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:01 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a Sep 01 02:11:01 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:01 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100 1073741824" returned: 0 in 0.527s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:01 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100 Sep 01 02:11:01 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:01 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a" returned: 0 in 0.443s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:01 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a Sep 01 02:11:01 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:01 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100" returned: 0 in 0.294s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3da94d08-ca2f-4b57-bbc6-52a7b3c29014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1978ab9-48e1-4b6e-82af-992233ac0100', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cb3d7c-f2ff-45cc-9a2a-21a1d7c76add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:01 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Volume volume-a1978ab9-48e1-4b6e-82af-992233ac0100 (a1978ab9-48e1-4b6e-82af-992233ac0100): created successfully Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13cb3d7c-f2ff-45cc-9a2a-21a1d7c76add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Flow 'volume_create_manager' (9cdfc820-3b21-4a05-826d-6acd049383cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:01 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9354f4c8-da48-4f8f-ac0c-e90f32c72d84 tempest-AttachVolumeTestJSON-1480235634 None] Created volume successfully. Sep 01 02:11:01 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-08384921-f4f4-454f-a484-2e395820105a" returned: 0 in 0.291s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Lock "cinder-quobyte-08384921-f4f4-454f-a484-2e395820105a" released by "delete_volume" :: held 0.795s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:01 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Created reservations ['23826bda-1fa3-4564-b2d9-d8d127ab323b'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:02 devstack cinder-volume[87389]: WARNING cinder.quota [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2145755557 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2145755557, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:11:02 devstack cinder-volume[87389]: WARNING cinder.quota [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2145755557 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2145755557, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Created reservations ['613cb9b4-8fd1-46fa-8c48-0c23cae07651', 'f2dcbb98-12f4-40dc-bb0f-fe5c3e889ccb', '6f58419c-e05b-4237-9c15-cb90596b5c9a', 'ba8359c2-a7a9-49a6-9b72-1956fcf35618'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:02 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:11:02 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:02 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.339s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:02 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a2b9689d-3ab7-40aa-ad9f-0050dd759f34 tempest-GroupsV314Test-1549874761 None] Delete group completed successfully. Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Acquiring lock "cinder-quobyte-e771f3f8-7d01-4e11-8d10-766431ce8958" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Lock "cinder-quobyte-e771f3f8-7d01-4e11-8d10-766431ce8958" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3b237f-7aa7-4e78-bfa2-35df4c680597]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:02 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 Sep 01 02:11:02 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-4989647a-da9d-4a31-b5a9-ba392cec8ced req-6efe084b-f18a-40e5-899a-5f65fd57f6fd tempest-TestMinimumBasicScenario-1029343942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-4989647a-da9d-4a31-b5a9-ba392cec8ced req-6efe084b-f18a-40e5-899a-5f65fd57f6fd tempest-TestMinimumBasicScenario-1029343942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-4989647a-da9d-4a31-b5a9-ba392cec8ced req-6efe084b-f18a-40e5-899a-5f65fd57f6fd tempest-TestMinimumBasicScenario-1029343942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-4989647a-da9d-4a31-b5a9-ba392cec8ced req-6efe084b-f18a-40e5-899a-5f65fd57f6fd tempest-TestMinimumBasicScenario-1029343942 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4257f811-29b0-49e8-9790-4a5c96cc922f', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:11:03 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-4989647a-da9d-4a31-b5a9-ba392cec8ced req-6efe084b-f18a-40e5-899a-5f65fd57f6fd tempest-TestMinimumBasicScenario-1029343942 None] attachment_update completed successfully. Sep 01 02:11:03 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958" returned: 0 in 0.569s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:03 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958 Sep 01 02:11:03 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:03 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e771f3f8-7d01-4e11-8d10-766431ce8958" returned: 0 in 0.494s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Lock "cinder-quobyte-e771f3f8-7d01-4e11-8d10-766431ce8958" released by "delete_volume" :: held 1.151s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:03 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Created reservations ['a447d603-38d2-44ed-8a40-b23ee86c18e9'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Created reservations ['a6aa428c-e1d6-42cc-8e98-018489994c1e', '75c6dea6-3022-412c-8c22-c8b997135e83', 'de07c38d-e772-4f84-9f43-1585fbe0efc2', '82119b42-5be1-45d1-b2e0-a79e167f4324'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:04 devstack sudo[97286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:11:04 devstack sudo[97286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-597db82c-cb55-4183-8dce-343c625fa44e req-bf48be3a-ac17-447a-a355-7f6c17c08551 tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-597db82c-cb55-4183-8dce-343c625fa44e req-bf48be3a-ac17-447a-a355-7f6c17c08551 tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-597db82c-cb55-4183-8dce-343c625fa44e req-bf48be3a-ac17-447a-a355-7f6c17c08551 tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-597db82c-cb55-4183-8dce-343c625fa44e req-bf48be3a-ac17-447a-a355-7f6c17c08551 tempest-AttachVolumeTestJSON-1480235634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-a1978ab9-48e1-4b6e-82af-992233ac0100', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c8bc91e-a48e-4681-abff-0d943138294e', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:11:04 devstack sudo[97286]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.450s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:04 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:04 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-69adc7bb-0c13-470a-b238-1087672d6b2e tempest-GroupsV314Test-1549874761 None] Delete group completed successfully. Sep 01 02:11:05 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-597db82c-cb55-4183-8dce-343c625fa44e req-bf48be3a-ac17-447a-a355-7f6c17c08551 tempest-AttachVolumeTestJSON-1480235634 None] attachment_update completed successfully. Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Flow 'volume_create_manager' (f16702d7-e60e-4fe8-95f2-4d5db1a27d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b5eb5d-bda0-4719-9d84-0920e428a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6b5eb5d-bda0-4719-9d84-0920e428a424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1079285249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89acb6c2-080a-43e6-abca-5ccf18a9ae3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd01ec4669f249818f4426f2c85681e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:07Z,use_quota=True,user_id='144603286fc6426a8ecc8f7580236d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841c3c39-40a7-4464-90f3-b77b0f6dad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (841c3c39-40a7-4464-90f3-b77b0f6dad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417ce7be-c451-4169-adb4-f5884bf7d899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417ce7be-c451-4169-adb4-f5884bf7d899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89acb6c2-080a-43e6-abca-5ccf18a9ae3c', 'volume_name': 'volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194373e8-f65a-4772-a53b-0bd27a676cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (194373e8-f65a-4772-a53b-0bd27a676cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea690dd-d196-458a-ab91-0f78955d98e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:07 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Volume 89acb6c2-080a-43e6-abca-5ccf18a9ae3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c', 'volume_size': 1} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1079285249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89acb6c2-080a-43e6-abca-5ccf18a9ae3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd01ec4669f249818f4426f2c85681e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:07Z,use_quota=True,user_id='144603286fc6426a8ecc8f7580236d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Creating volume 89acb6c2-080a-43e6-abca-5ccf18a9ae3c {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:07 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:11:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:07 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c 1073741824 Sep 01 02:11:07 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:08 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c 1073741824" returned: 0 in 0.630s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:08 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c Sep 01 02:11:08 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:08 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c" returned: 0 in 0.475s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea690dd-d196-458a-ab91-0f78955d98e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a64078f-e8f5-49b0-82d3-1b368d4a7ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:08 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Volume volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c (89acb6c2-080a-43e6-abca-5ccf18a9ae3c): created successfully Sep 01 02:11:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a64078f-e8f5-49b0-82d3-1b368d4a7ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Flow 'volume_create_manager' (f16702d7-e60e-4fe8-95f2-4d5db1a27d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:08 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1d9b297f-4ba6-4a45-9d50-af206ba801bb tempest-AttachVolumeTestJSON-1480235634 None] Created volume successfully. Sep 01 02:11:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-8b21422f-c451-495a-b45e-eebe626d1310 req-70221345-ac91-4976-bba5-fd4343c42262 tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-8b21422f-c451-495a-b45e-eebe626d1310 req-70221345-ac91-4976-bba5-fd4343c42262 tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-8b21422f-c451-495a-b45e-eebe626d1310 req-70221345-ac91-4976-bba5-fd4343c42262 tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-8b21422f-c451-495a-b45e-eebe626d1310 req-70221345-ac91-4976-bba5-fd4343c42262 tempest-AttachVolumeTestJSON-1480235634 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '023963f7-cb56-4e6d-a198-8dc7b6eb4604', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:11:11 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-8b21422f-c451-495a-b45e-eebe626d1310 req-70221345-ac91-4976-bba5-fd4343c42262 tempest-AttachVolumeTestJSON-1480235634 None] attachment_update completed successfully. Sep 01 02:11:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-6c9a36ab-84b2-4acd-a078-65d24d52a212 req-09f64fed-8331-45ca-9513-ab91193bb8ed tempest-AttachVolumeTestJSON-1480235634 None] Terminate volume connection completed successfully. Sep 01 02:11:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-6c9a36ab-84b2-4acd-a078-65d24d52a212 req-09f64fed-8331-45ca-9513-ab91193bb8ed tempest-AttachVolumeTestJSON-1480235634 None] Deleting attachment 2c8bc91e-a48e-4681-abff-0d943138294e. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:11:15 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-08e5678c-c7fd-410b-9e0f-2f3f9f8b9b84 req-8a503487-7906-4eff-8acd-e979bb5f023e tempest-AttachVolumeTestJSON-1480235634 None] Terminate volume connection completed successfully. Sep 01 02:11:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-08e5678c-c7fd-410b-9e0f-2f3f9f8b9b84 req-8a503487-7906-4eff-8acd-e979bb5f023e tempest-AttachVolumeTestJSON-1480235634 None] Deleting attachment 023963f7-cb56-4e6d-a198-8dc7b6eb4604. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:11:25 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=64,cinder:UPDATE=53,cinder:DELETE=4,cinder:INSERT=10 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:25 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=56,cinder:UPDATE=49,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:11:26 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "cinder-89acb6c2-080a-43e6-abca-5ccf18a9ae3c-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:26 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-89acb6c2-080a-43e6-abca-5ccf18a9ae3c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:26 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "cinder-quobyte-89acb6c2-080a-43e6-abca-5ccf18a9ae3c" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:26 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-quobyte-89acb6c2-080a-43e6-abca-5ccf18a9ae3c" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:26 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[436ae064-2f1f-46aa-8f89-436cac19d35a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:26 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c Sep 01 02:11:26 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:26 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c" returned: 0 in 0.547s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:26 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c Sep 01 02:11:26 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:27 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89acb6c2-080a-43e6-abca-5ccf18a9ae3c" returned: 0 in 0.457s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-quobyte-89acb6c2-080a-43e6-abca-5ccf18a9ae3c" released by "delete_volume" :: held 1.072s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Created reservations ['aed86ef5-3989-4ebd-82aa-747f1ae304fe', '7c33dc55-0102-47c6-8283-2a85378e084e', '0ad50bc3-a156-48e7-8def-3b4797bf818f', '7236cff8-f666-4db0-9a62-90ede7204160'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:27 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:11:27 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:27 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.391s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:27 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Deleted volume successfully. Sep 01 02:11:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7ba07593-4ce2-4e92-88b9-90540ef006d1 tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-89acb6c2-080a-43e6-abca-5ccf18a9ae3c-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "cinder-a1978ab9-48e1-4b6e-82af-992233ac0100-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-a1978ab9-48e1-4b6e-82af-992233ac0100-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "cinder-quobyte-a1978ab9-48e1-4b6e-82af-992233ac0100" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-quobyte-a1978ab9-48e1-4b6e-82af-992233ac0100" acquired by "delete_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:28 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ee32ea-6dcc-41e6-8987-41c4f48257e2]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:28 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100 Sep 01 02:11:28 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:28 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100" returned: 0 in 0.516s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:29 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100 Sep 01 02:11:29 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:29 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a1978ab9-48e1-4b6e-82af-992233ac0100" returned: 0 in 0.360s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-quobyte-a1978ab9-48e1-4b6e-82af-992233ac0100" released by "delete_volume" :: held 0.945s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:29 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Created reservations ['83cf2a47-2e9c-43d0-a2c4-17a020022789', '7744e6a2-047c-46f6-86f1-ad4fbe7de995', 'f1e42938-4447-4cce-af53-b6684617a4bd', '787c3371-57c5-4999-b762-12db18ddd2c3'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:29 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:11:29 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:29 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.365s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:29 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:30 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Deleted volume successfully. Sep 01 02:11:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cc0bea60-8cfc-4c09-a821-fda4bb56c48a tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-a1978ab9-48e1-4b6e-82af-992233ac0100-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "cinder-a2229b78-7b58-43a6-a3fb-a54b1fab45ca-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-a2229b78-7b58-43a6-a3fb-a54b1fab45ca-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "cinder-quobyte-a2229b78-7b58-43a6-a3fb-a54b1fab45ca" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-quobyte-a2229b78-7b58-43a6-a3fb-a54b1fab45ca" acquired by "delete_volume" :: waited 0.034s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:30 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe684032-2714-462e-8cd2-fa7e4b82afb2]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:31 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca Sep 01 02:11:31 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:31 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca" returned: 0 in 0.557s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:31 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca Sep 01 02:11:31 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:31 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Flow 'volume_create_manager' (0cf1df2f-0977-4aa7-8f05-208ff656dd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2034e18-5d4c-4e97-8dab-2dad5172999f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2034e18-5d4c-4e97-8dab-2dad5172999f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-786897061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6ad179-9335-431c-a8a1-7667a66a07ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037628dfab7d4ff7b392a70b9371d3e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:32Z,use_quota=True,user_id='90a055a48ddc47bcb52613c192c0c272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a423c47a-16d2-468e-8ec3-acdfb6963982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a423c47a-16d2-468e-8ec3-acdfb6963982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc362681-71ed-4257-b9e2-ac2eacf358ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:31 devstack cinder-volume[87389]: DEBUG cinder.image.glance [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Creating Keystone auth plugin from conf {{(pid=87389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:11:32 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a2229b78-7b58-43a6-a3fb-a54b1fab45ca" returned: 0 in 0.538s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-quobyte-a2229b78-7b58-43a6-a3fb-a54b1fab45ca" released by "delete_volume" :: held 1.181s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:32 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Created reservations ['ceeb0d02-d731-4b4f-8009-3acd0e578180', 'c5aadee1-eb1c-4a8f-893e-bf1bb6824e0c', 'a7011606-3675-408c-afd8-bb87226eee7d', 'ae136c2e-9c59-4cfb-8505-8e08957206fb'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:32 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:11:32 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:33 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.590s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:33 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:33 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Deleted volume successfully. Sep 01 02:11:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a346a15-a275-486d-b768-0ee93cac912d tempest-AttachVolumeTestJSON-1480235634 None] Lock "cinder-a2229b78-7b58-43a6-a3fb-a54b1fab45ca-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc362681-71ed-4257-b9e2-ac2eacf358ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b6ad179-9335-431c-a8a1-7667a66a07ab', 'volume_name': 'volume-3b6ad179-9335-431c-a8a1-7667a66a07ab', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98536ae-1d6e-40c7-8835-1070ca0b08d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f98536ae-1d6e-40c7-8835-1070ca0b08d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72465864-bf20-4dc0-8c12-85066a5483d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:33 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Volume 3b6ad179-9335-431c-a8a1-7667a66a07ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b6ad179-9335-431c-a8a1-7667a66a07ab', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:11:33 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Trying to clone 3b6ad179-9335-431c-a8a1-7667a66a07ab from image 97f1460d-e99d-469e-a933-615f59c7b55c at location (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]). {{(pid=87389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:11:33 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:11:33 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:11:33 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ba0cfe-1265-485c-8759-33aeddcb2742]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:34 devstack sudo[97494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD Sep 01 02:11:34 devstack sudo[97494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:34 devstack sudo[97494]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD" returned: 0 in 0.564s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:34 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Temporary image 97f1460d-e99d-469e-a933-615f59c7b55c is fetched for user 90a055a48ddc47bcb52613c192c0c272. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:11:34 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[49191013-a8f7-4660-b70f-bd16c47fa267]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:34 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD Sep 01 02:11:34 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:35 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-786897061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6ad179-9335-431c-a8a1-7667a66a07ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='037628dfab7d4ff7b392a70b9371d3e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:32Z,use_quota=True,user_id='90a055a48ddc47bcb52613c192c0c272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Creating volume 3b6ad179-9335-431c-a8a1-7667a66a07ab {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:35 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:35 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab 1073741824 Sep 01 02:11:35 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:35 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab 1073741824" returned: 0 in 0.681s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:36 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab Sep 01 02:11:36 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:36 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab" returned: 0 in 0.420s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:36 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Attempting download of 97f1460d-e99d-469e-a933-615f59c7b55c ((None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}])) to volume 3b6ad179-9335-431c-a8a1-7667a66a07ab. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:11:36 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa952ba-fc9f-4c15-9806-593413f2d944]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ghn9sznj {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:36 devstack sudo[97515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ghn9sznj Sep 01 02:11:36 devstack sudo[97515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:36 devstack sudo[97515]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ghn9sznj" returned: 0 in 0.446s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ghn9sznj {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:37 devstack sudo[97519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ghn9sznj Sep 01 02:11:37 devstack sudo[97519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:37 devstack sudo[97519]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ghn9sznj" returned: 1 in 0.443s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_ghn9sznj' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:11:37 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[822c6905-e8d9-4489-8770-c7ded3fe1829]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:37 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD Sep 01 02:11:37 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:38 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:38 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] 97f1460d-e99d-469e-a933-615f59c7b55c was qcow2, converting to qcow2 {{(pid=87389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:11:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:38 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab Sep 01 02:11:38 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:40 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab" returned: 0 in 2.513s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:40 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xovj6czedevstack@QuobyteHD, size 112.00 MB, duration 2.51 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:11:40 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Converted 112.00 MB image at 44.55 MB/s Sep 01 02:11:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:40 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab 1G Sep 01 02:11:40 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:41 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab 1G" returned: 0 in 0.668s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:41 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Downloaded image 97f1460d-e99d-469e-a933-615f59c7b55c ((None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}])) to volume 3b6ad179-9335-431c-a8a1-7667a66a07ab successfully. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:11:41 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Temporary image 97f1460d-e99d-469e-a933-615f59c7b55c for user 90a055a48ddc47bcb52613c192c0c272 is deleted. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:11:41 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Marking volume 3b6ad179-9335-431c-a8a1-7667a66a07ab as bootable. {{(pid=87389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:11:41 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Copying metadata from image 97f1460d-e99d-469e-a933-615f59c7b55c to 3b6ad179-9335-431c-a8a1-7667a66a07ab. {{(pid=87389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:11:41 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Creating volume glance metadata for volume 3b6ad179-9335-431c-a8a1-7667a66a07ab backed by image 97f1460d-e99d-469e-a933-615f59c7b55c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:11:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72465864-bf20-4dc0-8c12-85066a5483d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6ad179-9335-431c-a8a1-7667a66a07ab', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f46384-4ab1-4c14-9656-abdf04e0cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:41 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Volume volume-3b6ad179-9335-431c-a8a1-7667a66a07ab (3b6ad179-9335-431c-a8a1-7667a66a07ab): created successfully Sep 01 02:11:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f46384-4ab1-4c14-9656-abdf04e0cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Flow 'volume_create_manager' (0cf1df2f-0977-4aa7-8f05-208ff656dd67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f36cd524-7f86-4b9a-bfa3-979e1e428f95 tempest-TestShelveInstance-796483814 None] Created volume successfully. Sep 01 02:11:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-ff3eb19f-bfd2-473b-8d46-a9ca8c0fb957 req-83c0a64d-597e-4adb-99fd-2dd0daebee87 tempest-TestShelveInstance-796483814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-ff3eb19f-bfd2-473b-8d46-a9ca8c0fb957 req-83c0a64d-597e-4adb-99fd-2dd0daebee87 tempest-TestShelveInstance-796483814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-ff3eb19f-bfd2-473b-8d46-a9ca8c0fb957 req-83c0a64d-597e-4adb-99fd-2dd0daebee87 tempest-TestShelveInstance-796483814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-ff3eb19f-bfd2-473b-8d46-a9ca8c0fb957 req-83c0a64d-597e-4adb-99fd-2dd0daebee87 tempest-TestShelveInstance-796483814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-3b6ad179-9335-431c-a8a1-7667a66a07ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd1edebb8-d3d3-478d-a275-008bff1bb148', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:11:46 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-ff3eb19f-bfd2-473b-8d46-a9ca8c0fb957 req-83c0a64d-597e-4adb-99fd-2dd0daebee87 tempest-TestShelveInstance-796483814 None] attachment_update completed successfully. Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:47 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:11:47 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Flow 'volume_create_manager' (3b83abb1-dc6d-4889-8ad2-7fd11ad65c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34d8be4-0e73-43fb-9ce8-41a595ce7e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34d8be4-0e73-43fb-9ce8-41a595ce7e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-655743491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786034e8-17ed-497a-84dd-c24dc8318224,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fee3dc9ccc74d21aaa99df5d895fa46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:47Z,use_quota=True,user_id='0948511a6f5147f092c57679adec42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13911955-31c6-46a1-83f5-eefff4b72252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13911955-31c6-46a1-83f5-eefff4b72252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d152d8-74da-4867-9eea-3053f3eadbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d152d8-74da-4867-9eea-3053f3eadbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786034e8-17ed-497a-84dd-c24dc8318224', 'volume_name': 'volume-786034e8-17ed-497a-84dd-c24dc8318224', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c697006-94da-4d15-817d-cb64423da9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c697006-94da-4d15-817d-cb64423da9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3bdbd0-0e7d-4e16-8467-1deeee67d378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:47 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Volume 786034e8-17ed-497a-84dd-c24dc8318224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786034e8-17ed-497a-84dd-c24dc8318224', 'volume_size': 1} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-655743491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786034e8-17ed-497a-84dd-c24dc8318224,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fee3dc9ccc74d21aaa99df5d895fa46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:47Z,use_quota=True,user_id='0948511a6f5147f092c57679adec42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Creating volume 786034e8-17ed-497a-84dd-c24dc8318224 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:47 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:47 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224 1073741824 Sep 01 02:11:47 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:47 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.433s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:11:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:11:48 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224 1073741824" returned: 0 in 0.563s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:48 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224 Sep 01 02:11:48 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:48 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224" returned: 0 in 0.308s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3bdbd0-0e7d-4e16-8467-1deeee67d378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786034e8-17ed-497a-84dd-c24dc8318224', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4492f237-299c-4b46-8cb7-ef7a72f732bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:48 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Volume volume-786034e8-17ed-497a-84dd-c24dc8318224 (786034e8-17ed-497a-84dd-c24dc8318224): created successfully Sep 01 02:11:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4492f237-299c-4b46-8cb7-ef7a72f732bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Flow 'volume_create_manager' (3b83abb1-dc6d-4889-8ad2-7fd11ad65c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-81b91a73-0fbb-4722-9a70-30c0753274d0 tempest-VolumesTestJSON-179074562 None] Created volume successfully. Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Flow 'volume_create_manager' (e1759ec8-4959-43ac-b153-0100fce5bfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ba788c-f902-42df-82d4-7dbaf2f038de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90ba788c-f902-42df-82d4-7dbaf2f038de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-952016775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17825775-af5d-4a08-9fc8-eb4c6ec8a73f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fee3dc9ccc74d21aaa99df5d895fa46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:50Z,use_quota=True,user_id='0948511a6f5147f092c57679adec42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08329950-f770-4009-a12c-e9aa507e9c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08329950-f770-4009-a12c-e9aa507e9c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60683bc6-86fb-4ea6-bf00-8af2d0c8b54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60683bc6-86fb-4ea6-bf00-8af2d0c8b54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17825775-af5d-4a08-9fc8-eb4c6ec8a73f', 'volume_name': 'volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ff3efa-0017-42f3-823c-3933e17485bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ff3efa-0017-42f3-823c-3933e17485bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cf637b-bb9f-4fdc-8a71-93d5c57318a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:50 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Volume 17825775-af5d-4a08-9fc8-eb4c6ec8a73f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f', 'volume_size': 1} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-952016775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17825775-af5d-4a08-9fc8-eb4c6ec8a73f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fee3dc9ccc74d21aaa99df5d895fa46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:50Z,use_quota=True,user_id='0948511a6f5147f092c57679adec42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Creating volume 17825775-af5d-4a08-9fc8-eb4c6ec8a73f {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:50 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:50 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f 1073741824 Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:50 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Flow 'volume_create_manager' (b8a200b9-97c3-4203-96c7-9787e6918742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622b47a6-12b5-4408-a215-a64674b68a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622b47a6-12b5-4408-a215-a64674b68a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-497021346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28ab502-6a4c-416e-933f-0add80dd1f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad664362f72430d8f61a2a6e29089f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:50Z,use_quota=True,user_id='4979f90862344d469aaa4a726f6eab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e5c724-9a75-4f99-beb3-6a56dde32423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e5c724-9a75-4f99-beb3-6a56dde32423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef355381-42d0-4b2d-91bb-7630749f4973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef355381-42d0-4b2d-91bb-7630749f4973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f28ab502-6a4c-416e-933f-0add80dd1f30', 'volume_name': 'volume-f28ab502-6a4c-416e-933f-0add80dd1f30', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677bf8fc-69f8-4f65-a52c-27b2e2346932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (677bf8fc-69f8-4f65-a52c-27b2e2346932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff23a8f7-6d5c-410c-b750-1ce072db5d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:50 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Volume f28ab502-6a4c-416e-933f-0add80dd1f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f28ab502-6a4c-416e-933f-0add80dd1f30', 'volume_size': 1} Sep 01 02:11:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:51 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f 1073741824" returned: 0 in 0.680s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:51 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f Sep 01 02:11:51 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:51 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f" returned: 0 in 0.330s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.893s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-497021346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f28ab502-6a4c-416e-933f-0add80dd1f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad664362f72430d8f61a2a6e29089f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:50Z,use_quota=True,user_id='4979f90862344d469aaa4a726f6eab30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Creating volume f28ab502-6a4c-416e-933f-0add80dd1f30 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:51 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:51 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30 1073741824 Sep 01 02:11:51 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95cf637b-bb9f-4fdc-8a71-93d5c57318a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e83d456-a8f8-477f-83dd-9f3d1ce21129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:51 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Volume volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f (17825775-af5d-4a08-9fc8-eb4c6ec8a73f): created successfully Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e83d456-a8f8-477f-83dd-9f3d1ce21129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Flow 'volume_create_manager' (e1759ec8-4959-43ac-b153-0100fce5bfe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7e2f771c-416b-4547-a127-a9e7aab443a6 tempest-VolumesTestJSON-179074562 None] Created volume successfully. Sep 01 02:11:52 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30 1073741824" returned: 0 in 0.715s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:52 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30 Sep 01 02:11:52 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:52 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30" returned: 0 in 0.408s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff23a8f7-6d5c-410c-b750-1ce072db5d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f28ab502-6a4c-416e-933f-0add80dd1f30', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527d5ccc-c98b-441d-a629-363e11de3eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:52 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Volume volume-f28ab502-6a4c-416e-933f-0add80dd1f30 (f28ab502-6a4c-416e-933f-0add80dd1f30): created successfully Sep 01 02:11:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527d5ccc-c98b-441d-a629-363e11de3eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Flow 'volume_create_manager' (b8a200b9-97c3-4203-96c7-9787e6918742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:52 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8ecf7938-1678-4bd1-a4cb-ef460a1bedab tempest-AbsoluteLimitsTests-1838971889 None] Created volume successfully. Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Flow 'volume_create_manager' (d416c361-e387-4672-b39b-5642fdf03664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdbc817-4bbd-42b6-abbf-5047263e806d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdbc817-4bbd-42b6-abbf-5047263e806d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2132792771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81143fde-ac47-4842-b05d-b29b9bb8c799,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fee3dc9ccc74d21aaa99df5d895fa46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:53Z,use_quota=True,user_id='0948511a6f5147f092c57679adec42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79dad43-31e4-4f2b-872d-aa88ec1ff469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c79dad43-31e4-4f2b-872d-aa88ec1ff469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51931bcd-a5e2-4680-b31e-a2386f8b16cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51931bcd-a5e2-4680-b31e-a2386f8b16cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81143fde-ac47-4842-b05d-b29b9bb8c799', 'volume_name': 'volume-81143fde-ac47-4842-b05d-b29b9bb8c799', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c52919-e393-4a70-85d7-d9f662058dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c52919-e393-4a70-85d7-d9f662058dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2cdfdb-ca83-497b-879d-e7fb88b874f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:53 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Volume 81143fde-ac47-4842-b05d-b29b9bb8c799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81143fde-ac47-4842-b05d-b29b9bb8c799', 'volume_size': 1} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2132792771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81143fde-ac47-4842-b05d-b29b9bb8c799,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8fee3dc9ccc74d21aaa99df5d895fa46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:11:53Z,use_quota=True,user_id='0948511a6f5147f092c57679adec42ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Creating volume 81143fde-ac47-4842-b05d-b29b9bb8c799 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:11:53 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:53 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799 1073741824 Sep 01 02:11:53 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Acquiring lock "cinder-f28ab502-6a4c-416e-933f-0add80dd1f30-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Lock "cinder-f28ab502-6a4c-416e-933f-0add80dd1f30-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Acquiring lock "cinder-quobyte-f28ab502-6a4c-416e-933f-0add80dd1f30" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Lock "cinder-quobyte-f28ab502-6a4c-416e-933f-0add80dd1f30" acquired by "delete_volume" :: waited 0.038s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:54 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[020c8ef2-c1ab-4c33-b7b9-1b1c21408ecc]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:54 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30 Sep 01 02:11:54 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:54 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799 1073741824" returned: 0 in 0.959s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:54 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799 Sep 01 02:11:54 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:54 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30" returned: 0 in 0.726s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:54 devstack sudo[97681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30 Sep 01 02:11:54 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:55 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799" returned: 0 in 0.495s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb2cdfdb-ca83-497b-879d-e7fb88b874f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81143fde-ac47-4842-b05d-b29b9bb8c799', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0136d0-1774-4463-ae92-f44f7f627400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:11:55 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Volume volume-81143fde-ac47-4842-b05d-b29b9bb8c799 (81143fde-ac47-4842-b05d-b29b9bb8c799): created successfully Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0136d0-1774-4463-ae92-f44f7f627400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Flow 'volume_create_manager' (d416c361-e387-4672-b39b-5642fdf03664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:11:55 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-33053179-fb39-4e3c-9152-be93369178db tempest-VolumesTestJSON-179074562 None] Created volume successfully. Sep 01 02:11:55 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f28ab502-6a4c-416e-933f-0add80dd1f30" returned: 0 in 0.498s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Lock "cinder-quobyte-f28ab502-6a4c-416e-933f-0add80dd1f30" released by "delete_volume" :: held 1.332s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Created reservations ['bdede141-69a8-4f52-b37b-e4a504e09c52', 'fbf36103-482b-4997-9ce8-606acc17652f', '74e41c22-2ab9-4d50-88f3-66a1d90d0906', '4547e5d8-da99-4000-ad6b-1e1c62e5712d'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:55 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:11:55 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:55 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.322s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:11:55 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Deleted volume successfully. Sep 01 02:11:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e0c9421-6fae-4588-a469-1c0cbda20924 tempest-AbsoluteLimitsTests-1838971889 None] Lock "cinder-f28ab502-6a4c-416e-933f-0add80dd1f30-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:11:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Acquiring lock "cinder-81143fde-ac47-4842-b05d-b29b9bb8c799-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Lock "cinder-81143fde-ac47-4842-b05d-b29b9bb8c799-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Acquiring lock "cinder-quobyte-81143fde-ac47-4842-b05d-b29b9bb8c799" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:11:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Lock "cinder-quobyte-81143fde-ac47-4842-b05d-b29b9bb8c799" acquired by "delete_volume" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:11:58 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4504cf-a376-44b7-8397-ea65154dd9d5]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:11:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:59 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799 Sep 01 02:11:59 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:11:59 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Sep 01 02:11:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799" returned: 0 in 0.660s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:11:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:11:59 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799 Sep 01 02:11:59 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:00 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-81143fde-ac47-4842-b05d-b29b9bb8c799" returned: 0 in 0.550s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Lock "cinder-quobyte-81143fde-ac47-4842-b05d-b29b9bb8c799" released by "delete_volume" :: held 1.338s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:00 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Created reservations ['e3f2e82f-e440-4302-84de-156c9b7b164e', 'fd02d652-282e-44d5-b51a-4a3e3c774c51', '234b9619-bf50-40a8-9f81-bbdb8e6550b0', '343858d2-ae0b-4885-b971-bff3270141b5'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:00 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:00 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:01 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.543s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:01 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:01 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Deleted volume successfully. Sep 01 02:12:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0e1be046-7854-443d-8542-8203a2fc6f7a tempest-VolumesTestJSON-179074562 None] Lock "cinder-81143fde-ac47-4842-b05d-b29b9bb8c799-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Acquiring lock "cinder-17825775-af5d-4a08-9fc8-eb4c6ec8a73f-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Lock "cinder-17825775-af5d-4a08-9fc8-eb4c6ec8a73f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Acquiring lock "cinder-quobyte-17825775-af5d-4a08-9fc8-eb4c6ec8a73f" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Lock "cinder-quobyte-17825775-af5d-4a08-9fc8-eb4c6ec8a73f" acquired by "delete_volume" :: waited 0.066s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:01 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d816c8bd-171b-46d3-8930-c765dbae21ec]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:01 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-9ae3711f-52d1-4628-9502-e3ffa56f8e4f req-7111a2f4-101a-4635-ba5c-d6fa3b930781 tempest-TestMinimumBasicScenario-1029343942 None] Terminate volume connection completed successfully. Sep 01 02:12:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9ae3711f-52d1-4628-9502-e3ffa56f8e4f req-7111a2f4-101a-4635-ba5c-d6fa3b930781 tempest-TestMinimumBasicScenario-1029343942 None] Deleting attachment 4257f811-29b0-49e8-9790-4a5c96cc922f. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:12:01 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f Sep 01 02:12:01 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:02 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f" returned: 0 in 0.700s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:02 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f Sep 01 02:12:02 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:02 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-17825775-af5d-4a08-9fc8-eb4c6ec8a73f" returned: 0 in 0.318s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Lock "cinder-quobyte-17825775-af5d-4a08-9fc8-eb4c6ec8a73f" released by "delete_volume" :: held 1.087s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:02 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Created reservations ['cbcb1528-f69e-4f63-bb5e-567301e0e9aa', 'dbf268d7-de89-43ba-9818-799ebe5a8f5b', '9c0d9b85-0f23-4405-b936-476b4149d85f', '22966ddc-56ce-4eb5-a433-81a4cee9c823'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:02 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:02 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:03 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.297s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:03 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Deleted volume successfully. Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0783835d-d955-49bf-9520-39ca210901e2 tempest-VolumesTestJSON-179074562 None] Lock "cinder-17825775-af5d-4a08-9fc8-eb4c6ec8a73f-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Acquiring lock "cinder-3dba42b1-ad4c-43f4-bb98-5df0059d071d-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Lock "cinder-3dba42b1-ad4c-43f4-bb98-5df0059d071d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Acquiring lock "cinder-quobyte-3dba42b1-ad4c-43f4-bb98-5df0059d071d" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Lock "cinder-quobyte-3dba42b1-ad4c-43f4-bb98-5df0059d071d" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d9e094-4490-4e37-a197-b853ecb37c01]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Acquiring lock "cinder-786034e8-17ed-497a-84dd-c24dc8318224-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:03 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d Sep 01 02:12:03 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Lock "cinder-786034e8-17ed-497a-84dd-c24dc8318224-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Acquiring lock "cinder-quobyte-786034e8-17ed-497a-84dd-c24dc8318224" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Lock "cinder-quobyte-786034e8-17ed-497a-84dd-c24dc8318224" acquired by "delete_volume" :: waited 0.038s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:04 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2297e9-f02f-4122-9420-8011734ffd6a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:04 devstack sudo[97726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224 Sep 01 02:12:04 devstack sudo[97726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:04 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d" returned: 0 in 0.767s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:04 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d Sep 01 02:12:04 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:04 devstack sudo[97726]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224" returned: 0 in 0.628s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:04 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224 Sep 01 02:12:04 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:04 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3dba42b1-ad4c-43f4-bb98-5df0059d071d" returned: 0 in 0.462s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Lock "cinder-quobyte-3dba42b1-ad4c-43f4-bb98-5df0059d071d" released by "delete_volume" :: held 1.294s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Created reservations ['94415757-2531-4365-be71-a26aab3fecab', '7fd1db53-c1ff-4e11-a4ea-2b75c91ae776', '8917e5d3-75de-4e80-bfb6-02c578e557a9', 'eac985ea-4eea-4540-8b7c-0342c8eb9253'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:05 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-786034e8-17ed-497a-84dd-c24dc8318224" returned: 0 in 0.424s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Lock "cinder-quobyte-786034e8-17ed-497a-84dd-c24dc8318224" released by "delete_volume" :: held 1.134s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Created reservations ['4c67e031-0239-4fd3-a409-0e79f649972d', '8844136b-9bbb-4d99-ab98-eff8705b2d88', '12deefa4-7d01-43cd-85c6-d95d7265050a', '8ea79336-75c8-4065-8746-88a0ac240984'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:05 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:05 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:05 devstack sudo[97742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:05 devstack sudo[97742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:05 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.491s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:05 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Deleted volume successfully. Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7a112121-6e20-4cf1-9887-2e60f249bdf8 tempest-TestMinimumBasicScenario-1029343942 None] Lock "cinder-3dba42b1-ad4c-43f4-bb98-5df0059d071d-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:05 devstack sudo[97742]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.423s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:05 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Deleted volume successfully. Sep 01 02:12:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1176edce-251b-4541-8270-38d7f142eb65 tempest-VolumesTestJSON-179074562 None] Lock "cinder-786034e8-17ed-497a-84dd-c24dc8318224-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Flow 'volume_create_manager' (62040e98-db7c-472c-893c-43b596769b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a1fc11-6baa-4d7b-87d2-83adcf6f96ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5a1fc11-6baa-4d7b-87d2-83adcf6f96ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-473628778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c9affc-db47-43e7-84e7-50ce12f205c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a18861eef241529257aaa80fce5548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:07Z,use_quota=True,user_id='ad7bd636a2a44591a2899c0185bbe592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b7c894-afb7-413d-bec5-c7e418f7d6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b7c894-afb7-413d-bec5-c7e418f7d6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51433d27-c3c9-4777-b971-542d764155dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51433d27-c3c9-4777-b971-542d764155dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7c9affc-db47-43e7-84e7-50ce12f205c3', 'volume_name': 'volume-d7c9affc-db47-43e7-84e7-50ce12f205c3', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6a3f81-171e-4a54-90e0-4b716feae861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6a3f81-171e-4a54-90e0-4b716feae861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0835b51e-2901-4019-aa50-f1dcad2b9dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:07 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Volume d7c9affc-db47-43e7-84e7-50ce12f205c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7c9affc-db47-43e7-84e7-50ce12f205c3', 'volume_size': 1} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-473628778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c9affc-db47-43e7-84e7-50ce12f205c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a18861eef241529257aaa80fce5548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:07Z,use_quota=True,user_id='ad7bd636a2a44591a2899c0185bbe592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Creating volume d7c9affc-db47-43e7-84e7-50ce12f205c3 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:07 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:07 devstack sudo[97767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3 1073741824 Sep 01 02:12:07 devstack sudo[97767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:08 devstack sudo[97767]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3 1073741824" returned: 0 in 0.907s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:08 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3 Sep 01 02:12:08 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:08 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3" returned: 0 in 0.479s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.461s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0835b51e-2901-4019-aa50-f1dcad2b9dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7c9affc-db47-43e7-84e7-50ce12f205c3', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820e27bb-275c-472b-bbbe-98a51d568b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:08 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Volume volume-d7c9affc-db47-43e7-84e7-50ce12f205c3 (d7c9affc-db47-43e7-84e7-50ce12f205c3): created successfully Sep 01 02:12:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (820e27bb-275c-472b-bbbe-98a51d568b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Flow 'volume_create_manager' (62040e98-db7c-472c-893c-43b596769b1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:09 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-01829f4d-c7c3-4419-ab67-901fe629afb7 tempest-VolumesTransfersTest-1631413009 None] Created volume successfully. Sep 01 02:12:10 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5ba67bd4-0d91-4b40-ae63-16fd964d300e tempest-VolumesTransfersTest-1875466054 None] Transfer volume completed successfully. Sep 01 02:12:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Acquiring lock "cinder-d7c9affc-db47-43e7-84e7-50ce12f205c3-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Lock "cinder-d7c9affc-db47-43e7-84e7-50ce12f205c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Acquiring lock "cinder-quobyte-d7c9affc-db47-43e7-84e7-50ce12f205c3" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Lock "cinder-quobyte-d7c9affc-db47-43e7-84e7-50ce12f205c3" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:11 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c34a31-1809-4f78-9f3e-623dc23ab10d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:11 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3 Sep 01 02:12:11 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:12 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3" returned: 0 in 0.389s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:12 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3 Sep 01 02:12:12 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:12 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7c9affc-db47-43e7-84e7-50ce12f205c3" returned: 0 in 0.264s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Lock "cinder-quobyte-d7c9affc-db47-43e7-84e7-50ce12f205c3" released by "delete_volume" :: held 0.708s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:12 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Created reservations ['3aa0a08b-15a9-4c88-a9f3-9a494e4365bd', '7aa846c6-62c1-490c-997b-e4d39d47da90', '99f2e5c5-1bbc-4630-ad69-a02b11af244c', 'cfc03323-eaf1-433c-93ac-0b4da010f640'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:12 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:12 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:13 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.369s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Flow 'volume_create_manager' (8989863e-11af-4f0a-95e9-8920c645228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa498ac-f143-4d65-9f4a-ecf25b0a7e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:13 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Deleted volume successfully. Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fa498ac-f143-4d65-9f4a-ecf25b0a7e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1012632541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82dfc923-73a0-4a02-9165-9197c08b5c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38d54171c2d4fe298adaf8b352b7a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:13Z,use_quota=True,user_id='e74c5525eae24df88632912d363f82ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44387d2-95b2-4278-b7b4-1f70869ec424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d44387d2-95b2-4278-b7b4-1f70869ec424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370afabc-82f6-4ba1-aafc-1091b7ce0ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (370afabc-82f6-4ba1-aafc-1091b7ce0ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82dfc923-73a0-4a02-9165-9197c08b5c23', 'volume_name': 'volume-82dfc923-73a0-4a02-9165-9197c08b5c23', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25224ea-a0d0-4341-85fa-b3d8da36f176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a25224ea-a0d0-4341-85fa-b3d8da36f176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d68b2d9-7732-4a69-a477-503d1c911aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:13 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Volume 82dfc923-73a0-4a02-9165-9197c08b5c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82dfc923-73a0-4a02-9165-9197c08b5c23', 'volume_size': 1} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1012632541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82dfc923-73a0-4a02-9165-9197c08b5c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d38d54171c2d4fe298adaf8b352b7a4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:13Z,use_quota=True,user_id='e74c5525eae24df88632912d363f82ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Creating volume 82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:13 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-37f3fd52-e5d4-4b22-8373-150efd730179 tempest-VolumesTransfersTest-1543077983 None] Lock "cinder-d7c9affc-db47-43e7-84e7-50ce12f205c3-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:13 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 1073741824 Sep 01 02:12:13 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Flow 'volume_create_manager' (7ff65bf7-f219-4c06-975a-66bf7d0b82c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49edc4d5-c2cc-4973-af1b-08126a9b42f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49edc4d5-c2cc-4973-af1b-08126a9b42f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1670381920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38d9baa-61b5-44f1-9f8d-5a7c39cd159e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a18861eef241529257aaa80fce5548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:13Z,use_quota=True,user_id='ad7bd636a2a44591a2899c0185bbe592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3d92ab-e81e-4ac7-8029-2f1b35518b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3d92ab-e81e-4ac7-8029-2f1b35518b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e18fe9-23fe-40ab-aeee-fba3f976a6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e18fe9-23fe-40ab-aeee-fba3f976a6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c38d9baa-61b5-44f1-9f8d-5a7c39cd159e', 'volume_name': 'volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b578d6-1879-4baa-ac75-30994b52bf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b578d6-1879-4baa-ac75-30994b52bf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1684e1-a3e1-4d58-89cf-bf2fd35ab21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:13 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Volume c38d9baa-61b5-44f1-9f8d-5a7c39cd159e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e', 'volume_size': 1} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:13 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 1073741824" returned: 0 in 0.534s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:13 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 Sep 01 02:12:13 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:13 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23" returned: 0 in 0.279s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.379s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1670381920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c38d9baa-61b5-44f1-9f8d-5a7c39cd159e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a18861eef241529257aaa80fce5548',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:13Z,use_quota=True,user_id='ad7bd636a2a44591a2899c0185bbe592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Creating volume c38d9baa-61b5-44f1-9f8d-5a7c39cd159e {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:14 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:14 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e 1073741824 Sep 01 02:12:14 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d68b2d9-7732-4a69-a477-503d1c911aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82dfc923-73a0-4a02-9165-9197c08b5c23', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6ca30a-ca86-42f4-a893-2aecde84d6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:14 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Volume volume-82dfc923-73a0-4a02-9165-9197c08b5c23 (82dfc923-73a0-4a02-9165-9197c08b5c23): created successfully Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b6ca30a-ca86-42f4-a893-2aecde84d6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Flow 'volume_create_manager' (8989863e-11af-4f0a-95e9-8920c645228a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-37c9b75f-1397-46d6-b9ed-293c1822e814 tempest-SnapshotsActionsTest-1713409756 None] Created volume successfully. Sep 01 02:12:14 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e 1073741824" returned: 0 in 0.450s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:14 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e Sep 01 02:12:14 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:14 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e" returned: 0 in 0.257s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d1684e1-a3e1-4d58-89cf-bf2fd35ab21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5e137a-40e1-4864-bb21-c34a7be75143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:14 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Volume volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e (c38d9baa-61b5-44f1-9f8d-5a7c39cd159e): created successfully Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c5e137a-40e1-4864-bb21-c34a7be75143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Flow 'volume_create_manager' (7ff65bf7-f219-4c06-975a-66bf7d0b82c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1f81e0bb-e944-4498-9a56-4efd0b647575 tempest-VolumesTransfersTest-1631413009 None] Created volume successfully. Sep 01 02:12:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] Creating offline snapshot d244b699-f236-4090-bc80-68b16e56edb6 of volume 82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:15 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d2fe08-702a-4d6f-8ac2-d4240b8a619e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:15 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 Sep 01 02:12:15 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:15 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23" returned: 0 in 0.454s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:15 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 1G Sep 01 02:12:15 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Acquiring lock "cinder-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Lock "cinder-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Acquiring lock "cinder-quobyte-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Lock "cinder-quobyte-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0b60cc-027e-4456-a177-43bb7fda7c20]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:16 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e Sep 01 02:12:16 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:16 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 1G" returned: 0 in 0.569s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:16 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:16 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:16 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e" returned: 0 in 0.447s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:16 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e Sep 01 02:12:16 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:16 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.364s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:16 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 is being set with open permissions: ugo+rw Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:16 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:16 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:16 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e" returned: 0 in 0.314s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Lock "cinder-quobyte-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e" released by "delete_volume" :: held 0.817s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:16 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Created reservations ['eac9717e-ec7f-444a-b69a-6de497612113', 'ef9dc227-38f4-495f-84f8-2bbed1a5a8a4', 'eb34c010-e13e-4958-81c6-4f3c79dfcd96', '24f3a92c-682b-4af0-9957-dc09f46ebd83'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:17 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.422s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:17 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:17 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:17 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.info Sep 01 02:12:17 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:17 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.423s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:17 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Deleted volume successfully. Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9dd29879-d39b-42af-865c-fcd91885cae0 tempest-VolumesTransfersTest-1543077983 None] Lock "cinder-c38d9baa-61b5-44f1-9f8d-5a7c39cd159e-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:17 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.info" returned: 0 in 0.472s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:17 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.info is being set with open permissions: ugo+rw Sep 01 02:12:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:17 devstack sudo[97863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.info Sep 01 02:12:17 devstack sudo[97863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:18 devstack sudo[97863]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.info" returned: 0 in 0.303s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:18 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-24fdd91a-80a3-4ee4-b5e8-6c039ff35eb4 tempest-SnapshotsActionsTest-1713409756 None] Create snapshot completed successfully Sep 01 02:12:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] Creating offline snapshot 5d94be56-9ea5-44aa-8498-830d44b7f60e of volume 82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:19 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4819214-d5be-4086-8214-bf72936a05ef]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:19 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:19 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:20 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.581s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:20 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e 1G Sep 01 02:12:20 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:20 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e 1G" returned: 0 in 0.581s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:20 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e Sep 01 02:12:20 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:21 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e" returned: 0 in 0.547s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:21 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e is being set with open permissions: ugo+rw Sep 01 02:12:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:21 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e Sep 01 02:12:21 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:21 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e" returned: 0 in 0.398s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d4315a5f-2ab6-43f6-b5ad-a7795b26f752 tempest-SnapshotsActionsTest-1713409756 None] Create snapshot completed successfully Sep 01 02:12:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-5d94be56-9ea5-44aa-8498-830d44b7f60e-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-5d94be56-9ea5-44aa-8498-830d44b7f60e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-quobyte-5d94be56-9ea5-44aa-8498-830d44b7f60e" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-5d94be56-9ea5-44aa-8498-830d44b7f60e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Deleting offline snapshot 5d94be56-9ea5-44aa-8498-830d44b7f60e of volume 82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] snapshot_file for this snap is: volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f140dcf-425d-4f71-ab9b-d5ebab37b594]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:22 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e Sep 01 02:12:22 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:23 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e" returned: 0 in 0.439s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:23 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:23 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f139d5ba-68a5-4995-b7bd-5470e8143abe]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:23 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:23 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:23 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.472s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:23 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:23 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e Sep 01 02:12:23 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:24 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e" returned: 0 in 0.729s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:24 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e Sep 01 02:12:24 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:24 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.5d94be56-9ea5-44aa-8498-830d44b7f60e" returned: 0 in 0.305s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-5d94be56-9ea5-44aa-8498-830d44b7f60e" released by "_delete_snapshot" :: held 2.093s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" released by "delete_snapshot" :: held 2.116s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:24 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Created reservations ['e9da7b3b-f12a-4119-bdc1-da47c03d3b28', '100eed5d-c589-4eaa-9c7d-2357880d05c9', '4814d363-273f-423c-8d46-2e7909470385', '57dc542b-9843-43cb-92c1-d89c1dd833e6'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Delete snapshot completed successfully. Sep 01 02:12:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-feff076f-0608-4716-bebc-4bdb62fa160c tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-5d94be56-9ea5-44aa-8498-830d44b7f60e-delete_snapshot" released by "delete_snapshot" :: held 2.353s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:26 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=96,cinder:INSERT=33,cinder:UPDATE=108,cinder:DELETE=11 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:12:26 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=123,cinder:SELECT=89,cinder:INSERT=33,cinder:DELETE=9 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:12:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] Creating offline snapshot 0db3bed0-d7c9-406e-8479-213bfa510cb6 of volume 82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:26 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[54256edb-8539-463b-bda0-731246bfb45e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:26 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:26 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:27 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.765s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:27 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 1G Sep 01 02:12:27 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:27 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-46f41185-3c27-448f-a1f3-5127bdf40b9e req-93ba9e5d-b11e-4af4-bdba-f48d316e2d90 tempest-TestShelveInstance-796483814 None] Terminate volume connection completed successfully. Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-46f41185-3c27-448f-a1f3-5127bdf40b9e req-93ba9e5d-b11e-4af4-bdba-f48d316e2d90 tempest-TestShelveInstance-796483814 None] Deleting attachment d1edebb8-d3d3-478d-a275-008bff1bb148. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (b17e255c-568e-40a3-be03-5271d58052c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d10afcc-fc0e-4553-b173-e09d66bf6837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d10afcc-fc0e-4553-b173-e09d66bf6837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-816618467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1808c5e-0718-460a-a9b6-967a002b88d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:28Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0513059-4803-4803-9e4c-16f59c7fbc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0513059-4803-4803-9e4c-16f59c7fbc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a08038-58ff-4710-b520-dac7dad830a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a08038-58ff-4710-b520-dac7dad830a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1808c5e-0718-460a-a9b6-967a002b88d2', 'volume_name': 'volume-d1808c5e-0718-460a-a9b6-967a002b88d2', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab1a23c-ce81-40e7-b892-88878fccfa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ab1a23c-ce81-40e7-b892-88878fccfa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45552e7-2685-4b18-8a93-766f9afc9cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:27 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume d1808c5e-0718-460a-a9b6-967a002b88d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1808c5e-0718-460a-a9b6-967a002b88d2', 'volume_size': 1} Sep 01 02:12:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:28 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 1G" returned: 0 in 0.774s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:28 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 Sep 01 02:12:28 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:28 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Flow 'volume_create_manager' (4e7b7997-87c5-4812-b30e-09485e248840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7726097f-d5ec-498f-adc8-db4e234e446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6" returned: 0 in 0.475s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:28 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 is being set with open permissions: ugo+rw Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:28 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 Sep 01 02:12:28 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7726097f-d5ec-498f-adc8-db4e234e446a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1545172139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f715fe-74e8-4a54-a8f0-3401db7d02a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a1b2bd7da749139cac4066b0d8ad14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:28Z,use_quota=True,user_id='5626d0c10c514a7d944d637e13d86f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65782e45-f0c3-4138-9b20-11c02d933883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65782e45-f0c3-4138-9b20-11c02d933883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a873f5-c0b9-490e-8177-3a5becad8284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a873f5-c0b9-490e-8177-3a5becad8284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f715fe-74e8-4a54-a8f0-3401db7d02a0', 'volume_name': 'volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f142c70-12a3-4e93-abbf-00d16323f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f142c70-12a3-4e93-abbf-00d16323f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a568254-fe75-4462-8d5e-15f4c0f041ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:28 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Volume 92f715fe-74e8-4a54-a8f0-3401db7d02a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0', 'volume_size': 1} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:28 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6" returned: 0 in 0.296s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.460s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.030s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-816618467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1808c5e-0718-460a-a9b6-967a002b88d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:28Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Creating volume d1808c5e-0718-460a-a9b6-967a002b88d2 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:28 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:28 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2 1073741824 Sep 01 02:12:28 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:28 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e6cfe853-8447-4073-abcd-ab3d44cc7491 tempest-SnapshotsActionsTest-1713409756 None] Create snapshot completed successfully Sep 01 02:12:29 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2 1073741824" returned: 0 in 0.601s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:29 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2 Sep 01 02:12:29 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:29 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2" returned: 0 in 0.342s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.258s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1545172139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f715fe-74e8-4a54-a8f0-3401db7d02a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a1b2bd7da749139cac4066b0d8ad14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:28Z,use_quota=True,user_id='5626d0c10c514a7d944d637e13d86f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Creating volume 92f715fe-74e8-4a54-a8f0-3401db7d02a0 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:29 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-0db3bed0-d7c9-406e-8479-213bfa510cb6-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:29 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0 1073741824 Sep 01 02:12:29 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d45552e7-2685-4b18-8a93-766f9afc9cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1808c5e-0718-460a-a9b6-967a002b88d2', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b663fe1-c597-4e80-b87f-3078e1b1a6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:30 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume volume-d1808c5e-0718-460a-a9b6-967a002b88d2 (d1808c5e-0718-460a-a9b6-967a002b88d2): created successfully Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b663fe1-c597-4e80-b87f-3078e1b1a6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (b17e255c-568e-40a3-be03-5271d58052c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-0db3bed0-d7c9-406e-8479-213bfa510cb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:30 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5e36a1d4-dc68-44c6-a96d-36675765fb95 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created volume successfully. Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-quobyte-0db3bed0-d7c9-406e-8479-213bfa510cb6" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-0db3bed0-d7c9-406e-8479-213bfa510cb6" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Deleting offline snapshot 0db3bed0-d7c9-406e-8479-213bfa510cb6 of volume 82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] snapshot_file for this snap is: volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc45397-6795-4e6b-b028-dc3afd429574]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:30 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 Sep 01 02:12:30 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:30 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0 1073741824" returned: 0 in 0.771s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:30 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6" returned: 0 in 0.608s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3562d4d-a4a4-4670-9887-d5d297db090d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-95c3bf4a-f2bb-4b68-ac63-f47fdb492e9d req-f931bee7-ca0d-404f-be4f-33dfb84eed80 tempest-TestShelveInstance-796483814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:30 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0 Sep 01 02:12:30 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:30 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:30 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:31 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0" returned: 0 in 0.328s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-95c3bf4a-f2bb-4b68-ac63-f47fdb492e9d req-f931bee7-ca0d-404f-be4f-33dfb84eed80 tempest-TestShelveInstance-796483814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.348s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a568254-fe75-4462-8d5e-15f4c0f041ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c028f87-ced3-4eb2-a18a-8dfbe739b5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-95c3bf4a-f2bb-4b68-ac63-f47fdb492e9d req-f931bee7-ca0d-404f-be4f-33dfb84eed80 tempest-TestShelveInstance-796483814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:31 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Volume volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0 (92f715fe-74e8-4a54-a8f0-3401db7d02a0): created successfully Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c028f87-ced3-4eb2-a18a-8dfbe739b5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Flow 'volume_create_manager' (4e7b7997-87c5-4812-b30e-09485e248840) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:31 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d78f29f1-6b94-40ad-b37b-2131e75d7707 tempest-VolumesTransfersV357Test-41371000 None] Created volume successfully. Sep 01 02:12:31 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.471s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-95c3bf4a-f2bb-4b68-ac63-f47fdb492e9d req-f931bee7-ca0d-404f-be4f-33dfb84eed80 tempest-TestShelveInstance-796483814 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-3b6ad179-9335-431c-a8a1-7667a66a07ab', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93fc4e62-7043-41e2-8e03-f1ff387b8991', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:12:31 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 Sep 01 02:12:31 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:31 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-95c3bf4a-f2bb-4b68-ac63-f47fdb492e9d req-f931bee7-ca0d-404f-be4f-33dfb84eed80 tempest-TestShelveInstance-796483814 None] attachment_update completed successfully. Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (0372f221-3770-47d8-a051-cd6cf2ee4501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ff97f4-432b-4720-b078-d5b27019370c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:31 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93ff97f4-432b-4720-b078-d5b27019370c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-92375883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214b6d5c-e291-4aa9-a239-82d5effb3b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:32Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc55708-32a1-4966-9dcd-ee5df1d73932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc55708-32a1-4966-9dcd-ee5df1d73932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0140b2-c2e6-41f4-999b-a9fdb2b88d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0140b2-c2e6-41f4-999b-a9fdb2b88d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '214b6d5c-e291-4aa9-a239-82d5effb3b40', 'volume_name': 'volume-214b6d5c-e291-4aa9-a239-82d5effb3b40', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c396f78-6ed0-4ed8-a98e-148c5f0f84c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c396f78-6ed0-4ed8-a98e-148c5f0f84c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b5c94c-f9b0-4a47-80f6-4866a76854c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:31 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume 214b6d5c-e291-4aa9-a239-82d5effb3b40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-214b6d5c-e291-4aa9-a239-82d5effb3b40', 'volume_size': 1} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-92375883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214b6d5c-e291-4aa9-a239-82d5effb3b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:32Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Creating volume 214b6d5c-e291-4aa9-a239-82d5effb3b40 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:31 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6" returned: 0 in 0.701s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:31 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40 1073741824 Sep 01 02:12:32 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:32 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6 Sep 01 02:12:32 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:32 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.0db3bed0-d7c9-406e-8479-213bfa510cb6" returned: 0 in 0.664s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-0db3bed0-d7c9-406e-8479-213bfa510cb6" released by "_delete_snapshot" :: held 2.621s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" released by "delete_snapshot" :: held 2.660s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:32 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (723915dd-58e6-491b-b7be-2dde6c2e0acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bfddec-2d5e-4a40-9718-163b5f352bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bfddec-2d5e-4a40-9718-163b5f352bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450192144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1bc12c-2c63-43ef-8a70-51f65824dd89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:33Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7e3ceb-3a7c-4945-b20d-d7375d88e485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7e3ceb-3a7c-4945-b20d-d7375d88e485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0da3432-e32a-4278-b080-97fe4a852137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0da3432-e32a-4278-b080-97fe4a852137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1bc12c-2c63-43ef-8a70-51f65824dd89', 'volume_name': 'volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b2da4e-f9dc-4013-88d7-a41289ab7b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b2da4e-f9dc-4013-88d7-a41289ab7b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:33 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c837159-c333-44bb-bf23-3c76b0d46f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:33 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume 4e1bc12c-2c63-43ef-8a70-51f65824dd89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89', 'volume_size': 1} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40 1073741824" returned: 0 in 1.214s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Created reservations ['166afe72-f9b2-4f0d-9334-490b88448a1d', 'adb4479c-8249-4f10-a0fb-d14b11f3babd', '0023c72f-97b7-46f6-ac3d-57cc7f5fc029', 'ef621ee5-63f3-4123-bfdd-70cc822baf93'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:33 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40 Sep 01 02:12:33 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:33 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Delete snapshot completed successfully. Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-659d3126-8e87-4936-89ae-cb02c4edddf7 tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-0db3bed0-d7c9-406e-8479-213bfa510cb6-delete_snapshot" released by "delete_snapshot" :: held 3.280s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:33 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-61d914c8-53d9-419f-a74a-005cac2b1074 tempest-VolumesTransfersV357Test-735273661 None] Transfer volume completed successfully. Sep 01 02:12:33 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40" returned: 0 in 0.504s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.608s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450192144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1bc12c-2c63-43ef-8a70-51f65824dd89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:33Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Creating volume 4e1bc12c-2c63-43ef-8a70-51f65824dd89 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:33 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:33 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89 1073741824 Sep 01 02:12:33 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b5c94c-f9b0-4a47-80f6-4866a76854c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-214b6d5c-e291-4aa9-a239-82d5effb3b40', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f89944-3d24-4bd3-b169-fd8c935f45f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:33 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume volume-214b6d5c-e291-4aa9-a239-82d5effb3b40 (214b6d5c-e291-4aa9-a239-82d5effb3b40): created successfully Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54f89944-3d24-4bd3-b169-fd8c935f45f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (0372f221-3770-47d8-a051-cd6cf2ee4501) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:33 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (6a979e3c-b298-4c36-bd02-08977986c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10364c20-6b82-47ea-a1e4-25b265ff0dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:34 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e8e15f0f-5c94-49d8-9008-b23ea3512457 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created volume successfully. Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10364c20-6b82-47ea-a1e4-25b265ff0dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1742960528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374b615b-1cea-4875-a023-7979b3f08826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:34Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bf81f0-00d6-4d12-91f2-2ac5334ccd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bf81f0-00d6-4d12-91f2-2ac5334ccd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8669a130-ec1a-40cb-83ab-0ffafd9be683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8669a130-ec1a-40cb-83ab-0ffafd9be683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '374b615b-1cea-4875-a023-7979b3f08826', 'volume_name': 'volume-374b615b-1cea-4875-a023-7979b3f08826', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63060c79-94ea-457d-b9d1-beba30ac03dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63060c79-94ea-457d-b9d1-beba30ac03dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9f3158-b49f-49f4-9ae7-fee8ebfcc77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:34 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume 374b615b-1cea-4875-a023-7979b3f08826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-374b615b-1cea-4875-a023-7979b3f08826', 'volume_size': 1} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (606750ac-73eb-4d3e-a6cd-1dba9c10686e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321eae0b-69d3-4b78-aebd-488e0e90ce6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (321eae0b-69d3-4b78-aebd-488e0e90ce6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-325505233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08dd407-0921-411a-949f-263b1a47ca9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:34Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3eed207-0f65-4602-82ec-be159eaa3459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3eed207-0f65-4602-82ec-be159eaa3459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:34 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8c1871-b7ae-4099-bddb-8d456a18997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8c1871-b7ae-4099-bddb-8d456a18997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a08dd407-0921-411a-949f-263b1a47ca9b', 'volume_name': 'volume-a08dd407-0921-411a-949f-263b1a47ca9b', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e8338c-0f03-4824-b2e7-c66b7e130981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e8338c-0f03-4824-b2e7-c66b7e130981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55d1c4e-c4df-4c04-8813-7c879c6fedf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:34 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume a08dd407-0921-411a-949f-263b1a47ca9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a08dd407-0921-411a-949f-263b1a47ca9b', 'volume_size': 1} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89 1073741824" returned: 0 in 0.956s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:34 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89 Sep 01 02:12:34 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Acquiring lock "cinder-92f715fe-74e8-4a54-a8f0-3401db7d02a0-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Lock "cinder-92f715fe-74e8-4a54-a8f0-3401db7d02a0-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Acquiring lock "cinder-quobyte-92f715fe-74e8-4a54-a8f0-3401db7d02a0" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Lock "cinder-quobyte-92f715fe-74e8-4a54-a8f0-3401db7d02a0" acquired by "delete_volume" :: waited 0.037s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab915a1-db89-4640-bbbe-92d7bc2ebe09]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:35 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89" returned: 0 in 0.500s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] <== create_volume: return (1560ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.061s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1742960528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374b615b-1cea-4875-a023-7979b3f08826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:34Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Creating volume 374b615b-1cea-4875-a023-7979b3f08826 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:35 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:35 devstack sudo[98068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826 1073741824 Sep 01 02:12:35 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c837159-c333-44bb-bf23-3c76b0d46f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a041d0-b490-42d7-9de4-06a10137e73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:35 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89 (4e1bc12c-2c63-43ef-8a70-51f65824dd89): created successfully Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a041d0-b490-42d7-9de4-06a10137e73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (723915dd-58e6-491b-b7be-2dde6c2e0acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:35 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0 Sep 01 02:12:35 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (a646f40c-0c2b-4462-aaad-c13ba47c9a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa93aef-6d5e-44c2-850c-1df04e77afc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:35 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6da5789b-da16-460f-a06d-dfddc17bcf99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created volume successfully. Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa93aef-6d5e-44c2-850c-1df04e77afc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-270116598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146807bd-e0db-4c9d-82c2-ea72cbd221ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:35Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f28b491-9c56-4198-bbeb-b553ad088eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f28b491-9c56-4198-bbeb-b553ad088eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e5cea9-870d-41e1-8e6a-52512f0feede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e5cea9-870d-41e1-8e6a-52512f0feede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '146807bd-e0db-4c9d-82c2-ea72cbd221ae', 'volume_name': 'volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b5d49c-5f2e-4374-bc0c-267b3085eb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b5d49c-5f2e-4374-bc0c-267b3085eb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b2f1de-eab1-43f7-b64d-b85564dfa0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:35 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume 146807bd-e0db-4c9d-82c2-ea72cbd221ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae', 'volume_size': 1} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:35 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0" returned: 0 in 0.441s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:35 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0 Sep 01 02:12:35 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:35 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826 1073741824" returned: 0 in 0.578s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826 Sep 01 02:12:36 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:36 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-92f715fe-74e8-4a54-a8f0-3401db7d02a0" returned: 0 in 0.338s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Lock "cinder-quobyte-92f715fe-74e8-4a54-a8f0-3401db7d02a0" released by "delete_volume" :: held 0.892s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Created reservations ['982f72cb-fa8e-4927-b874-a6f839592f5c', 'a97e1fd5-a784-4deb-99ff-02711320fdee', '1e85e600-2c6f-46ab-8b28-c0fb97c408d4', 'c4935396-1e97-413a-bb6c-342e6392f40b'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:36 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:36 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826" returned: 0 in 0.518s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.765s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-325505233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08dd407-0921-411a-949f-263b1a47ca9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:34Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Creating volume a08dd407-0921-411a-949f-263b1a47ca9b {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:36 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:36 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b 1073741824 Sep 01 02:12:36 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9f3158-b49f-49f4-9ae7-fee8ebfcc77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-374b615b-1cea-4875-a023-7979b3f08826', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f6f7a5-4085-4d13-915b-408710adf0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:36 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume volume-374b615b-1cea-4875-a023-7979b3f08826 (374b615b-1cea-4875-a023-7979b3f08826): created successfully Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f6f7a5-4085-4d13-915b-408710adf0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (6a979e3c-b298-4c36-bd02-08977986c005) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:36 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0531047a-d3ab-4d51-ba0c-bb4235011b6f tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created volume successfully. Sep 01 02:12:36 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.491s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:36 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Deleted volume successfully. Sep 01 02:12:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-825dae4a-1450-4db3-89d2-bdddcfc5faf4 tempest-VolumesTransfersV357Test-1438646741 None] Lock "cinder-92f715fe-74e8-4a54-a8f0-3401db7d02a0-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:37 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b 1073741824" returned: 0 in 0.930s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:37 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b Sep 01 02:12:37 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:37 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b" returned: 0 in 0.463s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.648s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55d1c4e-c4df-4c04-8813-7c879c6fedf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08dd407-0921-411a-949f-263b1a47ca9b', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4add4ff-6ddd-48c3-a428-01273a129c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] Creating offline snapshot 84078250-394f-4993-9fe8-6b15e82afc09 of volume 82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:38 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume volume-a08dd407-0921-411a-949f-263b1a47ca9b (a08dd407-0921-411a-949f-263b1a47ca9b): created successfully Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4add4ff-6ddd-48c3-a428-01273a129c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (606750ac-73eb-4d3e-a6cd-1dba9c10686e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0064f627-2329-483e-b50f-9ab3e28c19a1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e0fcd572-4d3c-4db6-9f5e-3f3a70b3dad2 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created volume successfully. Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Flow 'volume_create_manager' (0573e837-4912-4186-9e7a-66fcbee4888b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65c47ba-6d4a-4dd1-8122-df7830078962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:38 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:38 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65c47ba-6d4a-4dd1-8122-df7830078962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1771005536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b96431-7bf7-417e-ac6c-4ccc453de792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a1b2bd7da749139cac4066b0d8ad14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:38Z,use_quota=True,user_id='5626d0c10c514a7d944d637e13d86f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5633923d-974a-4c6e-8329-4738c58cb4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5633923d-974a-4c6e-8329-4738c58cb4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83b8829-17ff-40f0-a158-f828709f8416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83b8829-17ff-40f0-a158-f828709f8416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b96431-7bf7-417e-ac6c-4ccc453de792', 'volume_name': 'volume-89b96431-7bf7-417e-ac6c-4ccc453de792', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ec998e-5fff-4cd4-b704-4981b1e888b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47ec998e-5fff-4cd4-b704-4981b1e888b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a00e3eb-03c5-443a-92ea-e270b2d0d6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:38 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Volume 89b96431-7bf7-417e-ac6c-4ccc453de792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b96431-7bf7-417e-ac6c-4ccc453de792', 'volume_size': 1} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:38 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.393s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:38 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 1G Sep 01 02:12:38 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:38 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 1G" returned: 0 in 0.431s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 Sep 01 02:12:39 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09" returned: 0 in 0.332s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 is being set with open permissions: ugo+rw Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 Sep 01 02:12:39 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09" returned: 0 in 0.308s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.684s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.091s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-270116598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=146807bd-e0db-4c9d-82c2-ea72cbd221ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0077c2fe9f5423caf4368fc10a5fc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:35Z,use_quota=True,user_id='60374bf7ec084b0aafaa0bd28a3b9666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Creating volume 146807bd-e0db-4c9d-82c2-ea72cbd221ae {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:39 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:39 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae 1073741824 Sep 01 02:12:39 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a6eb768c-33ed-46e4-80ea-c5bf6fbe13dd tempest-SnapshotsActionsTest-1713409756 None] Create snapshot completed successfully Sep 01 02:12:40 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae 1073741824" returned: 0 in 0.581s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-84078250-394f-4993-9fe8-6b15e82afc09-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:40 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae Sep 01 02:12:40 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-84078250-394f-4993-9fe8-6b15e82afc09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-quobyte-84078250-394f-4993-9fe8-6b15e82afc09" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-84078250-394f-4993-9fe8-6b15e82afc09" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Deleting offline snapshot 84078250-394f-4993-9fe8-6b15e82afc09 of volume 82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] snapshot_file for this snap is: volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a485275-cb20-4f96-969e-25f3abae054a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:40 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 Sep 01 02:12:40 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:40 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae" returned: 0 in 0.376s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.353s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1771005536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b96431-7bf7-417e-ac6c-4ccc453de792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45a1b2bd7da749139cac4066b0d8ad14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:38Z,use_quota=True,user_id='5626d0c10c514a7d944d637e13d86f1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Creating volume 89b96431-7bf7-417e-ac6c-4ccc453de792 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:40 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0b2f1de-eab1-43f7-b64d-b85564dfa0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:40 devstack sudo[98571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792 1073741824 Sep 01 02:12:40 devstack sudo[98571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4e9a91-4b9a-4ba5-83e5-04666137d565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:40 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Volume volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae (146807bd-e0db-4c9d-82c2-ea72cbd221ae): created successfully Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e4e9a91-4b9a-4ba5-83e5-04666137d565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Flow 'volume_create_manager' (a646f40c-0c2b-4462-aaad-c13ba47c9a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:40 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a0cc3400-c77b-447a-9bb5-9ef3e1cce332 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created volume successfully. Sep 01 02:12:40 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09" returned: 0 in 0.519s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f5185a-269a-4119-ac16-096eef667920]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:41 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:41 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:41 devstack sudo[98571]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792 1073741824" returned: 0 in 0.582s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:41 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792 Sep 01 02:12:41 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:41 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.478s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:41 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 Sep 01 02:12:41 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:41 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792" returned: 0 in 0.351s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a00e3eb-03c5-443a-92ea-e270b2d0d6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b96431-7bf7-417e-ac6c-4ccc453de792', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53488f7e-8364-4454-956b-bfe9acfb473d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:41 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Volume volume-89b96431-7bf7-417e-ac6c-4ccc453de792 (89b96431-7bf7-417e-ac6c-4ccc453de792): created successfully Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53488f7e-8364-4454-956b-bfe9acfb473d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Flow 'volume_create_manager' (0573e837-4912-4186-9e7a-66fcbee4888b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-18679a2d-5d5f-4b06-a081-c218d3759687 tempest-VolumesTransfersV357Test-41371000 None] Created volume successfully. Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-146807bd-e0db-4c9d-82c2-ea72cbd221ae-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-146807bd-e0db-4c9d-82c2-ea72cbd221ae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-quobyte-146807bd-e0db-4c9d-82c2-ea72cbd221ae" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-146807bd-e0db-4c9d-82c2-ea72cbd221ae" acquired by "delete_volume" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa08cf7e-7e78-4412-9ad7-20cc1e305c81]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:42 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09" returned: 0 in 0.544s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:42 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09 Sep 01 02:12:42 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:42 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae Sep 01 02:12:42 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:42 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.84078250-394f-4993-9fe8-6b15e82afc09" returned: 0 in 0.286s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-84078250-394f-4993-9fe8-6b15e82afc09" released by "_delete_snapshot" :: held 1.959s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" released by "delete_snapshot" :: held 1.992s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Created reservations ['37a921d3-3cea-4d1d-91a5-cc61305c7a9e', '610dd4c8-8961-4a13-9555-10f782e8de44', '8962ff4e-970f-45ea-9a5d-f90a10688620', 'affe2d26-35a4-4452-b01b-f558e5727c04'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:42 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae" returned: 0 in 0.593s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:42 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Delete snapshot completed successfully. Sep 01 02:12:42 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae Sep 01 02:12:42 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e2e261fc-94be-41b5-aa25-2da5c49dd22b tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-84078250-394f-4993-9fe8-6b15e82afc09-delete_snapshot" released by "delete_snapshot" :: held 2.310s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:42 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-146807bd-e0db-4c9d-82c2-ea72cbd221ae" returned: 0 in 0.304s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Acquiring lock "cinder-89b96431-7bf7-417e-ac6c-4ccc453de792-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-146807bd-e0db-4c9d-82c2-ea72cbd221ae" released by "delete_volume" :: held 0.969s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Lock "cinder-89b96431-7bf7-417e-ac6c-4ccc453de792-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Acquiring lock "cinder-quobyte-89b96431-7bf7-417e-ac6c-4ccc453de792" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created reservations ['47fd5e70-bbcd-44f6-9917-39b0032862c6', 'fba9742d-ee26-4941-927f-74ef79794b05', '1fa7f5bc-175f-464d-a6e5-349c5f6278e8', '2b50d2dd-15df-47ba-8c3e-5d6c8988786e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Lock "cinder-quobyte-89b96431-7bf7-417e-ac6c-4ccc453de792" acquired by "delete_volume" :: waited 0.050s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a4efd4-1ea1-42d9-95d1-3887b2493b21]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:43 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:43 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:43 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792 Sep 01 02:12:43 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:43 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.307s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:43 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Deleted volume successfully. Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2da186ba-c39c-45da-b4c8-5cacace508c4 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-146807bd-e0db-4c9d-82c2-ea72cbd221ae-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:43 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792" returned: 0 in 0.520s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:43 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792 Sep 01 02:12:43 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] Creating offline snapshot b19ec0b2-994b-4b5f-9317-c7d4c189a039 of volume 82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[32122645-4236-4e7b-a811-6d6aff55bbc6]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:44 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-89b96431-7bf7-417e-ac6c-4ccc453de792" returned: 0 in 0.364s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Lock "cinder-quobyte-89b96431-7bf7-417e-ac6c-4ccc453de792" released by "delete_volume" :: held 0.941s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Created reservations ['c8549901-bb8c-4f11-baf7-403f6af4906b', '2e83ff59-a139-48b7-89d7-da6462f155ae', 'b95426d0-66b8-48a1-9d19-099a94125d17', 'b407232c-f2e5-4193-b93f-8293fb2cdd26'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:44 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:44 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-a08dd407-0921-411a-949f-263b1a47ca9b-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-a08dd407-0921-411a-949f-263b1a47ca9b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:44 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:44 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-quobyte-a08dd407-0921-411a-949f-263b1a47ca9b" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-a08dd407-0921-411a-949f-263b1a47ca9b" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f270d2a1-f80a-4d30-b591-31c7f65c2cb9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:44 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.516s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:44 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b Sep 01 02:12:44 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:44 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 1G Sep 01 02:12:44 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:44 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.347s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:44 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Deleted volume successfully. Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c2ca3324-66f6-4d04-a591-3e684c1f6e8d tempest-VolumesTransfersV357Test-1438646741 None] Lock "cinder-89b96431-7bf7-417e-ac6c-4ccc453de792-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:44 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b" returned: 0 in 0.418s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:44 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b Sep 01 02:12:44 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:45 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 1G" returned: 0 in 0.524s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:45 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 Sep 01 02:12:45 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:45 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a08dd407-0921-411a-949f-263b1a47ca9b" returned: 0 in 0.292s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-a08dd407-0921-411a-949f-263b1a47ca9b" released by "delete_volume" :: held 0.771s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created reservations ['3fddaaef-76e8-4aca-a45c-52bbe54b86f1', 'c5e337cf-dd01-40fb-b584-a0c84acfc27c', '3964ce62-d7a9-4685-bc2a-116245282d43', '4a76b10f-be9a-4c0d-8700-9891ffa29c18'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:45 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:45 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-374b615b-1cea-4875-a023-7979b3f08826-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-374b615b-1cea-4875-a023-7979b3f08826-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:45 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-quobyte-374b615b-1cea-4875-a023-7979b3f08826" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039" returned: 0 in 0.551s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:45 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 is being set with open permissions: ugo+rw Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:45 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 Sep 01 02:12:45 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-374b615b-1cea-4875-a023-7979b3f08826" acquired by "delete_volume" :: waited 0.049s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[39df1ec1-4cf7-431c-9592-46fcd25daf49]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:45 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.471s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:45 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Deleted volume successfully. Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b289fcdb-b19e-4a16-978d-2844631ead99 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-a08dd407-0921-411a-949f-263b1a47ca9b-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:45 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039" returned: 0 in 0.292s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:45 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826 Sep 01 02:12:45 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:46 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-30ef3390-de4b-475a-840c-80bebe2a770b tempest-SnapshotsActionsTest-1713409756 None] Create snapshot completed successfully Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-b19ec0b2-994b-4b5f-9317-c7d4c189a039-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-b19ec0b2-994b-4b5f-9317-c7d4c189a039-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:46 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Acquiring lock "cinder-quobyte-b19ec0b2-994b-4b5f-9317-c7d4c189a039" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826" returned: 0 in 0.618s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-b19ec0b2-994b-4b5f-9317-c7d4c189a039" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Deleting offline snapshot b19ec0b2-994b-4b5f-9317-c7d4c189a039 of volume 82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:46 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826 Sep 01 02:12:46 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] snapshot_file for this snap is: volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f48a3bf-299c-4a8d-a3ac-fe99da8eb34b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:46 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 Sep 01 02:12:46 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:46 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-374b615b-1cea-4875-a023-7979b3f08826" returned: 0 in 0.368s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-374b615b-1cea-4875-a023-7979b3f08826" released by "delete_volume" :: held 1.061s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created reservations ['91ac80e7-5ffe-485d-bc7e-0f0674bed865', 'c5cc0545-aad3-4adf-8464-444a8ed31d83', '923cc260-5bff-4bd3-bed1-b9bfeb763e7e', '05d69493-ca24-4cbf-a677-e46b6ff0a159'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:46 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039" returned: 0 in 0.416s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e10f30-44d8-491e-a657-b3623fcfdd6f]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:47 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:47 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:47 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:47 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:47 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:47 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:47 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.403s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:47 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Deleted volume successfully. Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bc81691d-8e8b-4487-8ed5-fd840b490b35 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-374b615b-1cea-4875-a023-7979b3f08826-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:47 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.585s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:47 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 Sep 01 02:12:47 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:47 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.412s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-4e1bc12c-2c63-43ef-8a70-51f65824dd89-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-4e1bc12c-2c63-43ef-8a70-51f65824dd89-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-quobyte-4e1bc12c-2c63-43ef-8a70-51f65824dd89" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-4e1bc12c-2c63-43ef-8a70-51f65824dd89" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cd9da3-1bb3-4f26-a82a-e35b26c9d196]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:48 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039" returned: 0 in 0.657s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:48 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89 Sep 01 02:12:48 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:48 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039 Sep 01 02:12:48 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:48 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.b19ec0b2-994b-4b5f-9317-c7d4c189a039" returned: 0 in 0.346s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-b19ec0b2-994b-4b5f-9317-c7d4c189a039" released by "_delete_snapshot" :: held 2.147s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" released by "delete_snapshot" :: held 2.194s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Created reservations ['7a121633-ecbf-4517-8c8c-4a5636f6378a', '427dfb9b-b536-41c4-b71b-766cba3849a9', 'f754dece-7609-4811-a1c3-8648f910aeb4', '335a4af8-8ad2-42e4-a73f-f15ffadb318e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:48 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89" returned: 0 in 0.639s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:48 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89 Sep 01 02:12:48 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Delete snapshot completed successfully. Sep 01 02:12:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e4a7773-0a0c-481b-90b5-842265c3e34e tempest-SnapshotsActionsTest-1294463101 None] Lock "cinder-b19ec0b2-994b-4b5f-9317-c7d4c189a039-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:49 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4e1bc12c-2c63-43ef-8a70-51f65824dd89" returned: 0 in 0.323s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-4e1bc12c-2c63-43ef-8a70-51f65824dd89" released by "delete_volume" :: held 1.037s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created reservations ['2b5e1cfa-573f-4e0e-b093-71426b69901c', '10bed6b1-82aa-481e-a797-40add8e79082', '5c2f8a2a-ece1-47fc-b006-9d2c8776e59b', '4344b453-c9b7-4613-989a-e437c27040d4'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:49 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:49 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:49 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.286s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:49 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Deleted volume successfully. Sep 01 02:12:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dcdb4e0a-f576-4155-b4b9-8932e441814b tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-4e1bc12c-2c63-43ef-8a70-51f65824dd89-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "cinder-d244b699-f236-4090-bc80-68b16e56edb6-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Lock "cinder-d244b699-f236-4090-bc80-68b16e56edb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "cinder-quobyte-d244b699-f236-4090-bc80-68b16e56edb6" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Lock "cinder-quobyte-d244b699-f236-4090-bc80-68b16e56edb6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Deleting offline snapshot d244b699-f236-4090-bc80-68b16e56edb6 of volume 82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] snapshot_file for this snap is: volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[805b521a-a5c2-47a8-922a-2aabb644ae25]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-214b6d5c-e291-4aa9-a239-82d5effb3b40-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-214b6d5c-e291-4aa9-a239-82d5effb3b40-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:50 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:50 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-quobyte-214b6d5c-e291-4aa9-a239-82d5effb3b40" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-214b6d5c-e291-4aa9-a239-82d5effb3b40" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a23f1e2-6e3f-4f11-b9ae-0fb4a6e74f3c]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:50 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40 Sep 01 02:12:50 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:50 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.552s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82dfc923-73a0-4a02-9165-9197c08b5c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb7d4f4-f69e-45d6-a8d5-a9dee0527921]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:50 devstack sudo[98702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 Sep 01 02:12:50 devstack sudo[98702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:51 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40" returned: 0 in 0.495s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:51 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40 Sep 01 02:12:51 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:51 devstack sudo[98702]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23" returned: 0 in 0.489s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:51 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:51 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:51 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-214b6d5c-e291-4aa9-a239-82d5effb3b40" returned: 0 in 0.318s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-214b6d5c-e291-4aa9-a239-82d5effb3b40" released by "delete_volume" :: held 0.890s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created reservations ['8090d71f-6624-48f0-9dec-d728a37f5c76', '44c9b77d-988a-4f97-b0a0-42a8034ed50c', '41b157b2-f694-448f-890f-6ad650c34a0a', 'cd68614e-c40e-48a1-a07e-886154dfd28c'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:51 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:51 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:51 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.444s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:51 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6 Sep 01 02:12:51 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:51 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.326s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Deleted volume successfully. Sep 01 02:12:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb46c589-18c9-473b-9625-86f2866402b9 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-214b6d5c-e291-4aa9-a239-82d5effb3b40-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:52 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23.d244b699-f236-4090-bc80-68b16e56edb6" returned: 0 in 0.318s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Lock "cinder-quobyte-d244b699-f236-4090-bc80-68b16e56edb6" released by "_delete_snapshot" :: held 1.956s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" released by "delete_snapshot" :: held 1.989s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:52 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Created reservations ['cca638ad-fbcb-42ae-bd46-e02538d00336', '91b42fd1-8414-4a8e-8b53-7f9bde6a8ad3', '651d07d1-cd5c-494d-a9e3-0af778267fa1', '9ad3fa11-669c-42a0-aadc-eda0462a27a1'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:52 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Delete snapshot completed successfully. Sep 01 02:12:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-339010c8-0411-4d6e-9589-2fb0566efefe tempest-SnapshotsActionsTest-1713409756 None] Lock "cinder-d244b699-f236-4090-bc80-68b16e56edb6-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-d1808c5e-0718-460a-a9b6-967a002b88d2-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-d1808c5e-0718-460a-a9b6-967a002b88d2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "cinder-quobyte-d1808c5e-0718-460a-a9b6-967a002b88d2" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-d1808c5e-0718-460a-a9b6-967a002b88d2" acquired by "delete_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:52 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fdff79-5426-4141-8d09-1e165e707646]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:52 devstack sudo[98727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2 Sep 01 02:12:52 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:53 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2" returned: 0 in 0.395s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:53 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2 Sep 01 02:12:53 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "cinder-82dfc923-73a0-4a02-9165-9197c08b5c23-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Lock "cinder-82dfc923-73a0-4a02-9165-9197c08b5c23-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:12:53 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d1808c5e-0718-460a-a9b6-967a002b88d2" returned: 0 in 0.344s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-quobyte-d1808c5e-0718-460a-a9b6-967a002b88d2" released by "delete_volume" :: held 0.810s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" acquired by "delete_volume" :: waited 0.041s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[022e2318-5769-4af5-bad8-c069cc9d13ac]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Created reservations ['f9c7b7c2-1867-4ac5-a3da-b6c9b83f23bc', 'ef73a2e8-4730-4817-bcc3-00e7c449aaf5', '17ef68c5-9bb9-4d2c-85b6-431f2660af79', 'a5fa6013-c8e2-4939-9371-f160c68a5043'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:53 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 Sep 01 02:12:53 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:53 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:53 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Flow 'volume_create_manager' (955a55ee-9615-4744-909a-1a5dbb4dbebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb202d3-308e-4352-9adb-cbb150d31347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb202d3-308e-4352-9adb-cbb150d31347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1886411358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4795873-f813-4974-b6a4-c4c3243fc74d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2ba9adac074ad5be7fa8f179f2769d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:54Z,use_quota=True,user_id='71067e43a77440b7864cea0c201919ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d887cf2-8d1e-4931-ab37-b56ab425fc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d887cf2-8d1e-4931-ab37-b56ab425fc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613f6d38-4c2f-491a-adad-69d48af288dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.image.glance [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Creating Keystone auth plugin from conf {{(pid=87389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:12:54 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.452s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:54 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Deleted volume successfully. Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c335be28-c048-4cb9-af1c-ef6325b9c6b7 tempest-CreateVolumesFromSourceVolumeTest-1698563380 None] Lock "cinder-d1808c5e-0718-460a-a9b6-967a002b88d2-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:54 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23" returned: 0 in 0.773s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:54 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23 Sep 01 02:12:54 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:54 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-82dfc923-73a0-4a02-9165-9197c08b5c23" returned: 0 in 0.295s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (613f6d38-4c2f-491a-adad-69d48af288dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a4795873-f813-4974-b6a4-c4c3243fc74d', 'volume_name': 'volume-a4795873-f813-4974-b6a4-c4c3243fc74d', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73d3aee-230d-4f5e-9858-76599691ab66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73d3aee-230d-4f5e-9858-76599691ab66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2bb220-328f-4e98-bd30-8894a7209492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:54 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Volume a4795873-f813-4974-b6a4-c4c3243fc74d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a4795873-f813-4974-b6a4-c4c3243fc74d', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Trying to clone a4795873-f813-4974-b6a4-c4c3243fc74d from image 97f1460d-e99d-469e-a933-615f59c7b55c at location (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]). {{(pid=87389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Lock "cinder-quobyte-82dfc923-73a0-4a02-9165-9197c08b5c23" released by "delete_volume" :: held 1.174s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Created reservations ['f6c024c0-5b72-4887-8d40-5f1fc2eba49b', 'f4f62500-9c7e-4e6d-b1c0-37c59b0c5cc2', '06e3fee6-3597-4900-93c1-2a8443e9c556', '4d1935bc-2a5d-498a-b342-be468d2f52b2'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:54 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:12:55 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:12:55 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:12:55 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29249ac-e6da-48bd-8ca9-bda8ea02cb89]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:55 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.348s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:55 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:12:55 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Deleted volume successfully. Sep 01 02:12:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e5ce6a98-f5de-415c-ad4e-9921eb2bb367 tempest-SnapshotsActionsTest-1713409756 None] Lock "cinder-82dfc923-73a0-4a02-9165-9197c08b5c23-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:12:55 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD Sep 01 02:12:55 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:55 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:55 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Temporary image 97f1460d-e99d-469e-a933-615f59c7b55c is fetched for user 71067e43a77440b7864cea0c201919ae. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:12:55 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e58f108-6ebe-4c35-b689-f9a000b526bb]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:55 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD Sep 01 02:12:55 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:56 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1886411358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4795873-f813-4974-b6a4-c4c3243fc74d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2ba9adac074ad5be7fa8f179f2769d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:54Z,use_quota=True,user_id='71067e43a77440b7864cea0c201919ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Creating volume a4795873-f813-4974-b6a4-c4c3243fc74d {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:56 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:56 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d 1073741824 Sep 01 02:12:56 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:56 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d 1073741824" returned: 0 in 0.535s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:56 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d Sep 01 02:12:56 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:57 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d" returned: 0 in 0.296s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:57 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Attempting download of 97f1460d-e99d-469e-a933-615f59c7b55c ((None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}])) to volume a4795873-f813-4974-b6a4-c4c3243fc74d. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:12:57 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[69996032-affe-438a-afeb-965571ed7556]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_8cbe0sj6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:57 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_8cbe0sj6 Sep 01 02:12:57 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:57 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_8cbe0sj6" returned: 0 in 0.409s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_8cbe0sj6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:57 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_8cbe0sj6 Sep 01 02:12:57 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:58 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_8cbe0sj6" returned: 1 in 0.440s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_8cbe0sj6' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae96d75-44fb-4ed1-a31a-0ae5272e93df]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:58 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD Sep 01 02:12:58 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:58 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Flow 'volume_create_manager' (97518696-2df7-4ab2-9119-06c5bf9a5942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32f1818-3118-4cbd-8f5f-13bf87bd86ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] 97f1460d-e99d-469e-a933-615f59c7b55c was qcow2, converting to qcow2 {{(pid=87389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:58 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f32f1818-3118-4cbd-8f5f-13bf87bd86ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-388076758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0688c059-ca7e-40ad-bb7e-10ec0a9194c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e8a86d35784031bc2695f59070eda6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:58Z,use_quota=True,user_id='0507046814264c27a7b96fd05c740de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:58 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905d3cfe-bcc9-4a63-a761-c00702e3f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905d3cfe-bcc9-4a63-a761-c00702e3f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bbe6a7-c140-4cb2-9f57-22fabca5ad66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bbe6a7-c140-4cb2-9f57-22fabca5ad66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0688c059-ca7e-40ad-bb7e-10ec0a9194c8', 'volume_name': 'volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9e7f4-6086-48c0-91c4-cce372d1db5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d9e7f4-6086-48c0-91c4-cce372d1db5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dbb7b4-d59d-45c7-a491-f9f9cfccac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:58 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Volume 0688c059-ca7e-40ad-bb7e-10ec0a9194c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8', 'volume_size': 1} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-388076758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0688c059-ca7e-40ad-bb7e-10ec0a9194c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e8a86d35784031bc2695f59070eda6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:12:58Z,use_quota=True,user_id='0507046814264c27a7b96fd05c740de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Creating volume 0688c059-ca7e-40ad-bb7e-10ec0a9194c8 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:12:58 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:12:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:58 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 1073741824 Sep 01 02:12:58 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:59 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 1073741824" returned: 0 in 0.531s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:12:59 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 Sep 01 02:12:59 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:12:59 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 01 02:12:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" returned: 0 in 0.340s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:12:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:12:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:12:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dbb7b4-d59d-45c7-a491-f9f9cfccac73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f4c366-a655-470d-9a3e-713f6261e6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:12:59 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Volume volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 (0688c059-ca7e-40ad-bb7e-10ec0a9194c8): created successfully Sep 01 02:12:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f4c366-a655-470d-9a3e-713f6261e6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:12:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Flow 'volume_create_manager' (97518696-2df7-4ab2-9119-06c5bf9a5942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:12:59 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8331251f-fda8-425e-ac26-e50f81974f98 tempest-VolumeDependencyTests-1926967981 None] Created volume successfully. Sep 01 02:13:00 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d" returned: 0 in 2.043s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:00 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_nl4x2coydevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:13:00 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Converted 112.00 MB image at 54.79 MB/s Sep 01 02:13:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:00 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d 1G Sep 01 02:13:00 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] Creating offline snapshot 1d9ac61b-4f72-45de-8a4a-759f0578dec9 of volume 0688c059-ca7e-40ad-bb7e-10ec0a9194c8 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:13:00 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2a0be7-e199-403f-9cf0-9d547341a863]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:00 devstack sudo[98837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 Sep 01 02:13:00 devstack sudo[98837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:00 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d 1G" returned: 0 in 0.392s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:00 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Downloaded image 97f1460d-e99d-469e-a933-615f59c7b55c ((None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}])) to volume a4795873-f813-4974-b6a4-c4c3243fc74d successfully. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Temporary image 97f1460d-e99d-469e-a933-615f59c7b55c for user 71067e43a77440b7864cea0c201919ae is deleted. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Marking volume a4795873-f813-4974-b6a4-c4c3243fc74d as bootable. {{(pid=87389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Copying metadata from image 97f1460d-e99d-469e-a933-615f59c7b55c to a4795873-f813-4974-b6a4-c4c3243fc74d. {{(pid=87389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Creating volume glance metadata for volume a4795873-f813-4974-b6a4-c4c3243fc74d backed by image 97f1460d-e99d-469e-a933-615f59c7b55c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2bb220-328f-4e98-bd30-8894a7209492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4795873-f813-4974-b6a4-c4c3243fc74d', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3940277-260e-4c0f-9a3a-193296d9b7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:01 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Volume volume-a4795873-f813-4974-b6a4-c4c3243fc74d (a4795873-f813-4974-b6a4-c4c3243fc74d): created successfully Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3940277-260e-4c0f-9a3a-193296d9b7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Flow 'volume_create_manager' (955a55ee-9615-4744-909a-1a5dbb4dbebe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:01 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c1507935-9aa3-45e3-9a00-89d0f715ecc3 tempest-VolumesExtendTest-3044692 None] Created volume successfully. Sep 01 02:13:01 devstack sudo[98837]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" returned: 0 in 0.512s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:01 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 1G Sep 01 02:13:01 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-df3f8d18-cf8d-4769-b969-5fdc987c1ece tempest-VolumesExtendTest-3044692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:01 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 1G" returned: 0 in 0.574s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:01 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 Sep 01 02:13:01 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:02 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9" returned: 0 in 0.364s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:02 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 is being set with open permissions: ugo+rw Sep 01 02:13:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:02 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 Sep 01 02:13:02 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:02 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9" returned: 0 in 0.282s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:02 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.info Sep 01 02:13:02 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:02 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.info" returned: 0 in 0.302s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:02 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.info is being set with open permissions: ugo+rw Sep 01 02:13:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:02 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.info Sep 01 02:13:02 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:03 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.info" returned: 0 in 0.293s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-df3f8d18-cf8d-4769-b969-5fdc987c1ece tempest-VolumesExtendTest-3044692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.455s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:03 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[09aee7e8-cd3c-4ef6-85c8-bc69c8471660]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-df3f8d18-cf8d-4769-b969-5fdc987c1ece tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:03 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e247a343-8fa9-4398-84d6-ea41f5bea7dc tempest-VolumeDependencyTests-1926967981 None] Create snapshot completed successfully Sep 01 02:13:03 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d Sep 01 02:13:03 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:03 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-df3f8d18-cf8d-4769-b969-5fdc987c1ece tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d" returned: 0 in 0.468s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-df3f8d18-cf8d-4769-b969-5fdc987c1ece tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d 2G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-df3f8d18-cf8d-4769-b969-5fdc987c1ece tempest-VolumesExtendTest-3044692 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d 2G" returned: 0 in 0.109s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-df3f8d18-cf8d-4769-b969-5fdc987c1ece tempest-VolumesExtendTest-3044692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.601s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:03 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-df3f8d18-cf8d-4769-b969-5fdc987c1ece tempest-VolumesExtendTest-3044692 None] Extend volume completed successfully. Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Acquiring lock "cinder-a4795873-f813-4974-b6a4-c4c3243fc74d-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Lock "cinder-a4795873-f813-4974-b6a4-c4c3243fc74d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Acquiring lock "cinder-quobyte-a4795873-f813-4974-b6a4-c4c3243fc74d" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Lock "cinder-quobyte-a4795873-f813-4974-b6a4-c4c3243fc74d" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91223bb-10ae-4176-98d9-ed240db4c231]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:04 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d Sep 01 02:13:04 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Flow 'volume_create_manager' (3118e61e-7867-4e70-b2ff-322d39783b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3a4e3e-b186-4083-a51c-5a67c0d03742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef3a4e3e-b186-4083-a51c-5a67c0d03742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1302685103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ab94e2b-3e2a-49e9-8a77-57fb13f9e581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2e8a86d35784031bc2695f59070eda6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1d9ac61b-4f72-45de-8a4a-759f0578dec9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:05Z,use_quota=True,user_id='0507046814264c27a7b96fd05c740de4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583f9afd-4869-4c8f-a01c-cf4ab05db34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:04 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583f9afd-4869-4c8f-a01c-cf4ab05db34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db64cb38-c0d2-4ff4-8a0b-9e02091fa964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db64cb38-c0d2-4ff4-8a0b-9e02091fa964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ab94e2b-3e2a-49e9-8a77-57fb13f9e581', 'volume_name': 'volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581', 'volume_size': 1, 'snapshot_id': '1d9ac61b-4f72-45de-8a4a-759f0578dec9'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281cbffd-a4bd-4adf-a2a0-c39acdbcef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281cbffd-a4bd-4adf-a2a0-c39acdbcef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05242550-bf65-4a1f-b80e-6f811281fe44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:04 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Volume 3ab94e2b-3e2a-49e9-8a77-57fb13f9e581: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581', 'volume_size': 1, 'snapshot_id': '1d9ac61b-4f72-45de-8a4a-759f0578dec9'} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d" returned: 0 in 0.489s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "cinder-quobyte-1d9ac61b-4f72-45de-8a4a-759f0578dec9-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" by "_create_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:04 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d Sep 01 02:13:04 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-1d9ac61b-4f72-45de-8a4a-759f0578dec9-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Creating volume 3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 from snapshot 1d9ac61b-4f72-45de-8a4a-759f0578dec9 {{(pid=87389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "cinder-quobyte-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] snapshot: 1d9ac61b-4f72-45de-8a4a-759f0578dec9, volume: 3ab94e2b-3e2a-49e9-8a77-57fb13f9e581, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[841a0add-3799-49f7-bbf5-72cce7bc328d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:05 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 Sep 01 02:13:05 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:05 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a4795873-f813-4974-b6a4-c4c3243fc74d" returned: 0 in 0.303s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Lock "cinder-quobyte-a4795873-f813-4974-b6a4-c4c3243fc74d" released by "delete_volume" :: held 0.842s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Created reservations ['6349e213-2480-4d96-918a-7a70b324651d', '016f3057-4b64-4060-aa1c-a258c5c2606f', 'cdaa96b8-2a62-4f9f-a013-902ca5a3152b', '3533ee2c-2675-483a-905f-2680ded00fe0'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:05 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:13:05 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:05 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9" returned: 0 in 0.431s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57adcc0-ea7f-42aa-84b5-b166fef2e6f9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:05 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 Sep 01 02:13:05 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:05 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.305s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:05 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Deleted volume successfully. Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da4424cd-b722-42d6-817c-06301b9939fe tempest-VolumesExtendTest-3044692 None] Lock "cinder-a4795873-f813-4974-b6a4-c4c3243fc74d-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:05 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" returned: 0 in 0.512s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:13:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:06 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 Sep 01 02:13:06 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Flow 'volume_create_manager' (aebb91fe-a1a7-4292-99fa-79992a8fa25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd8f7d7-d0e3-431b-8fa4-63b4d2914b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd8f7d7-d0e3-431b-8fa4-63b4d2914b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-519132173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef0c089-cdca-4e16-9402-403928f7bf13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2ba9adac074ad5be7fa8f179f2769d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:06Z,use_quota=True,user_id='71067e43a77440b7864cea0c201919ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94a1d25-3350-4dfe-a1a3-c9c70437a83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b94a1d25-3350-4dfe-a1a3-c9c70437a83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd22a999-a8d7-434f-89d6-9ddb5bd3b92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd22a999-a8d7-434f-89d6-9ddb5bd3b92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef0c089-cdca-4e16-9402-403928f7bf13', 'volume_name': 'volume-7ef0c089-cdca-4e16-9402-403928f7bf13', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799e109e-6a4c-4e83-b37c-51907db85f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799e109e-6a4c-4e83-b37c-51907db85f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b07392-6978-4aba-a092-45e5f0201b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:06 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Volume 7ef0c089-cdca-4e16-9402-403928f7bf13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef0c089-cdca-4e16-9402-403928f7bf13', 'volume_size': 1} Sep 01 02:13:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:11 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" returned: 0 in 5.046s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:13:11 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Converted 1024.00 MB image at 202.91 MB/s Sep 01 02:13:11 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 is being set with open permissions: ugo+rw Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:11 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 Sep 01 02:13:11 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:11 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" returned: 0 in 0.248s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" released by "_copy_volume_from_snapshot" :: held 6.337s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-1d9ac61b-4f72-45de-8a4a-759f0578dec9-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" released by "_create_volume_from_snapshot" :: held 6.405s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.420s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.132s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-519132173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef0c089-cdca-4e16-9402-403928f7bf13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa2ba9adac074ad5be7fa8f179f2769d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:06Z,use_quota=True,user_id='71067e43a77440b7864cea0c201919ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Creating volume 7ef0c089-cdca-4e16-9402-403928f7bf13 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:11 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:11 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 1073741824 Sep 01 02:13:11 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05242550-bf65-4a1f-b80e-6f811281fe44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581', 'volume_size': 1, 'snapshot_id': '1d9ac61b-4f72-45de-8a4a-759f0578dec9'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab30ec2-9f7a-4317-ab14-40ca7aa85841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:11 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Volume volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 (3ab94e2b-3e2a-49e9-8a77-57fb13f9e581): created successfully Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab30ec2-9f7a-4317-ab14-40ca7aa85841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Flow 'volume_create_manager' (3118e61e-7867-4e70-b2ff-322d39783b3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:11 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-090aa93d-094f-426b-bb73-60a7e7b085d1 tempest-VolumeDependencyTests-1926967981 None] Created volume successfully. Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "cinder-1d9ac61b-4f72-45de-8a4a-759f0578dec9-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-1d9ac61b-4f72-45de-8a4a-759f0578dec9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "cinder-quobyte-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "cinder-quobyte-1d9ac61b-4f72-45de-8a4a-759f0578dec9" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-1d9ac61b-4f72-45de-8a4a-759f0578dec9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Deleting offline snapshot 1d9ac61b-4f72-45de-8a4a-759f0578dec9 of volume 0688c059-ca7e-40ad-bb7e-10ec0a9194c8 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] snapshot_file for this snap is: volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cf5fed-2580-45dd-a76e-c83923fa9091]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:11 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 Sep 01 02:13:11 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:11 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 1073741824" returned: 0 in 0.530s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:11 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 Sep 01 02:13:11 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:12 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9" returned: 0 in 0.424s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[949b247e-00bd-40b9-94dc-d3d61a987185]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:12 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13" returned: 0 in 0.301s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b07392-6978-4aba-a092-45e5f0201b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef0c089-cdca-4e16-9402-403928f7bf13', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182599ac-133b-4f6e-8c09-4021920aa8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:12 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Volume volume-7ef0c089-cdca-4e16-9402-403928f7bf13 (7ef0c089-cdca-4e16-9402-403928f7bf13): created successfully Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182599ac-133b-4f6e-8c09-4021920aa8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Flow 'volume_create_manager' (aebb91fe-a1a7-4292-99fa-79992a8fa25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:12 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-59e08fb5-f403-403f-8221-18e0e57f3557 tempest-VolumesExtendTest-3044692 None] Created volume successfully. Sep 01 02:13:12 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 Sep 01 02:13:12 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:12 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" returned: 0 in 0.594s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:12 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 Sep 01 02:13:12 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] Creating offline snapshot cc8dcf67-bfca-4c37-8181-0636a9bd8419 of volume 7ef0c089-cdca-4e16-9402-403928f7bf13 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1b5558-e14c-4a4c-beac-ec5d77fe3c18]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:13 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 Sep 01 02:13:13 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:13 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9" returned: 0 in 0.418s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:13 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9 Sep 01 02:13:13 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:13 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13" returned: 0 in 0.442s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:13 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8.1d9ac61b-4f72-45de-8a4a-759f0578dec9" returned: 0 in 0.298s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:13 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 1G Sep 01 02:13:13 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-1d9ac61b-4f72-45de-8a4a-759f0578dec9" released by "_delete_snapshot" :: held 1.854s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" released by "delete_snapshot" :: held 1.878s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Created reservations ['09435d70-6807-4034-9da3-1b30004aee90', '96778a16-4b6d-4efa-a153-d44456a4e217', '967af4f9-8a71-42a3-b633-b5ad78f263df', 'ab2800ef-8f11-4976-a59d-631d613250b7'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:13 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Delete snapshot completed successfully. Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-407d9053-7d7b-4ff7-85f3-66ce2aeb0acf tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-1d9ac61b-4f72-45de-8a4a-759f0578dec9-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "cinder-0688c059-ca7e-40ad-bb7e-10ec0a9194c8-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-0688c059-ca7e-40ad-bb7e-10ec0a9194c8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "cinder-quobyte-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7113f5a-7d4d-4f1c-a0a7-ded790ae05b0]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:14 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 1G" returned: 0 in 0.531s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef0c089-cdca-4e16-9402-403928f7bf13 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:14 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef0c089-cdca-4e16-9402-403928f7bf13 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 Sep 01 02:13:14 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:14 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 Sep 01 02:13:14 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:14 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ef0c089-cdca-4e16-9402-403928f7bf13 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419" returned: 0 in 0.347s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:14 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 is being set with open permissions: ugo+rw Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:14 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" returned: 0 in 0.402s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:14 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 Sep 01 02:13:14 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:14 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8 Sep 01 02:13:14 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:14 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419" returned: 0 in 0.274s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:14 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" returned: 0 in 0.269s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-0688c059-ca7e-40ad-bb7e-10ec0a9194c8" released by "delete_volume" :: held 0.746s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:14 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.info Sep 01 02:13:14 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Created reservations ['aeff1d8e-83fd-4ab7-bd33-6dd402674351', '235e9e77-32d7-43c9-b6c1-48e4829bf8bf', '93095f2f-06fa-4528-8b8a-19c4e8fe7e7a', '0822ea01-a9bd-492f-86e7-4310a5c85868'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:14 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:13:14 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:15 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.info" returned: 0 in 0.352s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:15 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.info is being set with open permissions: ugo+rw Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "cinder-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:15 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.info Sep 01 02:13:15 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "cinder-quobyte-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:15 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.370s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:15 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Deleted volume successfully. Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f32b65-c1c2-431d-adcc-663b1682c637]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c79c9d66-6ba7-4a66-8511-cf922adb31e8 tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-0688c059-ca7e-40ad-bb7e-10ec0a9194c8-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:15 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 Sep 01 02:13:15 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:15 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.info" returned: 0 in 0.299s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.388s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:15 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-da53f86e-4ec9-4d45-9e6a-d6d495fd6aa4 tempest-VolumesExtendTest-3044692 None] Create snapshot completed successfully Sep 01 02:13:15 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" returned: 0 in 0.425s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:15 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581 Sep 01 02:13:15 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:15 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" returned: 0 in 0.280s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-quobyte-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581" released by "delete_volume" :: held 0.772s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Created reservations ['c6741a90-2e32-401b-9f38-adc911ddc2e4', '440813e9-24f8-4c01-834f-17148a791516', '2cbc99b0-a2cc-4b9f-ad41-5670e6f5bb78', '359b2540-f66c-495b-84e5-ffea60222241'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:16 devstack sudo[98999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:13:16 devstack sudo[98999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59eb8dc9-a083-4e2b-928f-08f002183aa9 tempest-VolumesExtendTest-3044692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59eb8dc9-a083-4e2b-928f-08f002183aa9 tempest-VolumesExtendTest-3044692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb1f071-7045-470a-9a47-709d0ddbc50e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59eb8dc9-a083-4e2b-928f-08f002183aa9 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:16 devstack sudo[98999]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.382s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:16 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Deleted volume successfully. Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ab796b2-91c6-4992-ae51-f7905cfb090d tempest-VolumeDependencyTests-1926967981 None] Lock "cinder-3ab94e2b-3e2a-49e9-8a77-57fb13f9e581-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:16 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 Sep 01 02:13:16 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:16 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59eb8dc9-a083-4e2b-928f-08f002183aa9 tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13" returned: 0 in 0.504s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59eb8dc9-a083-4e2b-928f-08f002183aa9 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 2G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59eb8dc9-a083-4e2b-928f-08f002183aa9 tempest-VolumesExtendTest-3044692 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 2G" returned: 0 in 0.285s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59eb8dc9-a083-4e2b-928f-08f002183aa9 tempest-VolumesExtendTest-3044692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.858s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:17 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-59eb8dc9-a083-4e2b-928f-08f002183aa9 tempest-VolumesExtendTest-3044692 None] Extend volume completed successfully. Sep 01 02:13:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Acquiring lock "cinder-cc8dcf67-bfca-4c37-8181-0636a9bd8419-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:17 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Flow 'volume_create_manager' (33343e0f-952f-4a25-9b70-fc1ae0ae48f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8166dac9-01de-417b-9d98-7c150595f1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8166dac9-01de-417b-9d98-7c150595f1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1630748680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4730b89-e4a7-45cc-bc98-68955d917c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bbe692f7054826a45637e70820d8a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:18Z,use_quota=True,user_id='d81e09d736644f57a8e727dcd06dd352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b601b0e-51ac-426b-b1e0-551b34936674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b601b0e-51ac-426b-b1e0-551b34936674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506b75ef-ea07-4eb5-b5a5-398c060cebbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506b75ef-ea07-4eb5-b5a5-398c060cebbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4730b89-e4a7-45cc-bc98-68955d917c2a', 'volume_name': 'volume-c4730b89-e4a7-45cc-bc98-68955d917c2a', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2ec895-ea25-4e60-b931-835a94e9b952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2ec895-ea25-4e60-b931-835a94e9b952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f631b9d-24cb-498a-b735-c4ce94807d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:18 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Volume c4730b89-e4a7-45cc-bc98-68955d917c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4730b89-e4a7-45cc-bc98-68955d917c2a', 'volume_size': 1} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1630748680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4730b89-e4a7-45cc-bc98-68955d917c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bbe692f7054826a45637e70820d8a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:18Z,use_quota=True,user_id='d81e09d736644f57a8e727dcd06dd352',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Creating volume c4730b89-e4a7-45cc-bc98-68955d917c2a {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:18 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Lock "cinder-cc8dcf67-bfca-4c37-8181-0636a9bd8419-delete_snapshot" acquired by "delete_snapshot" :: waited 0.221s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Acquiring lock "cinder-quobyte-7ef0c089-cdca-4e16-9402-403928f7bf13" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:18 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a 1073741824 Sep 01 02:13:18 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Lock "cinder-quobyte-7ef0c089-cdca-4e16-9402-403928f7bf13" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Acquiring lock "cinder-quobyte-cc8dcf67-bfca-4c37-8181-0636a9bd8419" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Lock "cinder-quobyte-cc8dcf67-bfca-4c37-8181-0636a9bd8419" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Deleting offline snapshot cc8dcf67-bfca-4c37-8181-0636a9bd8419 of volume 7ef0c089-cdca-4e16-9402-403928f7bf13 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] snapshot_file for this snap is: volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba010e9-7cdc-46da-b475-51a035c9da78]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:18 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 Sep 01 02:13:18 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:18 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a 1073741824" returned: 0 in 0.745s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:18 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419" returned: 0 in 0.654s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ef0c089-cdca-4e16-9402-403928f7bf13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:18 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a Sep 01 02:13:18 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf609a9-fb09-4d4c-b6c7-aa660000ac5d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:19 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 Sep 01 02:13:19 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:19 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a" returned: 0 in 0.296s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f631b9d-24cb-498a-b735-c4ce94807d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4730b89-e4a7-45cc-bc98-68955d917c2a', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e158b3f-7190-411e-a555-5f7a88b657af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:19 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Volume volume-c4730b89-e4a7-45cc-bc98-68955d917c2a (c4730b89-e4a7-45cc-bc98-68955d917c2a): created successfully Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e158b3f-7190-411e-a555-5f7a88b657af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Flow 'volume_create_manager' (33343e0f-952f-4a25-9b70-fc1ae0ae48f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3bb9686d-b8b3-4dac-b780-c1c5aad8defd tempest-VolumeQuotasNegativeTestJSON-207591293 None] Created volume successfully. Sep 01 02:13:19 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13" returned: 0 in 0.469s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:19 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 Sep 01 02:13:19 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-b2b8f7b1-6792-4908-a4d1-bb74b25f773a tempest-TestShelveInstance-796483814 None] Terminate volume connection completed successfully. Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-b2b8f7b1-6792-4908-a4d1-bb74b25f773a tempest-TestShelveInstance-796483814 None] Deleting attachment 93fc4e62-7043-41e2-8e03-f1ff387b8991. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:13:19 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419" returned: 0 in 0.550s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:19 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419 Sep 01 02:13:19 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Acquiring lock "cinder-3b6ad179-9335-431c-a8a1-7667a66a07ab-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Lock "cinder-3b6ad179-9335-431c-a8a1-7667a66a07ab-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Acquiring lock "cinder-quobyte-3b6ad179-9335-431c-a8a1-7667a66a07ab" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Lock "cinder-quobyte-3b6ad179-9335-431c-a8a1-7667a66a07ab" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:20 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9b4c8b-0baf-4df7-a716-58af46b75804]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:20 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13.cc8dcf67-bfca-4c37-8181-0636a9bd8419" returned: 0 in 0.522s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Lock "cinder-quobyte-cc8dcf67-bfca-4c37-8181-0636a9bd8419" released by "_delete_snapshot" :: held 2.385s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Lock "cinder-quobyte-7ef0c089-cdca-4e16-9402-403928f7bf13" released by "delete_snapshot" :: held 2.445s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:20 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab Sep 01 02:13:20 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:20 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Created reservations ['30f11374-9d59-4d30-82fd-0fcf01809d16', '23840872-d9b9-446c-85b1-60b6b1a7ed61', '76ea1c64-c5ef-48ac-ab3f-95f73eec95a2', '3e25b45f-6e4d-4d90-8d9e-a3ed32fc27a6'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Delete snapshot completed successfully. Sep 01 02:13:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-01bd85af-824d-4667-91af-d1a483d330d9 tempest-VolumesExtendTest-3044692 None] Lock "cinder-cc8dcf67-bfca-4c37-8181-0636a9bd8419-delete_snapshot" released by "delete_snapshot" :: held 2.755s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:21 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab" returned: 0 in 0.684s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:21 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab Sep 01 02:13:21 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Acquiring lock "cinder-7ef0c089-cdca-4e16-9402-403928f7bf13-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Lock "cinder-7ef0c089-cdca-4e16-9402-403928f7bf13-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Acquiring lock "cinder-quobyte-7ef0c089-cdca-4e16-9402-403928f7bf13" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Lock "cinder-quobyte-7ef0c089-cdca-4e16-9402-403928f7bf13" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:21 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3b6ad179-9335-431c-a8a1-7667a66a07ab" returned: 0 in 0.477s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Lock "cinder-quobyte-3b6ad179-9335-431c-a8a1-7667a66a07ab" released by "delete_volume" :: held 1.237s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c0dbc7-4624-4faa-a23c-c743a0025b39]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.quota [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Created reservations ['321b2b25-4be8-4208-9c4f-1ce622ee71dc', 'e16dc1c9-a924-43f8-a303-7261db8f2341', '022951bb-9bea-4edc-a0ac-6030a1107d87', '4a2a057a-1384-4a36-94f1-5d3db5a7ff3a'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Acquiring lock "cinder-c4730b89-e4a7-45cc-bc98-68955d917c2a-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:21 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 Sep 01 02:13:21 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Lock "cinder-c4730b89-e4a7-45cc-bc98-68955d917c2a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Acquiring lock "cinder-quobyte-c4730b89-e4a7-45cc-bc98-68955d917c2a" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:21 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:13:21 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Lock "cinder-quobyte-c4730b89-e4a7-45cc-bc98-68955d917c2a" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e923ed1d-d3c3-492d-af8b-cc793a723eeb]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:21 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a Sep 01 02:13:21 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:22 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.286s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG cinder.manager [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:22 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Deleted volume successfully. Sep 01 02:13:22 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13" returned: 0 in 0.548s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [req-826485f2-d7e3-4d2f-8b01-f08e9b6919a2 req-f1179f7e-c29e-4076-b818-336a81998e0d tempest-TestShelveInstance-796483814 None] Lock "cinder-3b6ad179-9335-431c-a8a1-7667a66a07ab-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:22 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13 Sep 01 02:13:22 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:22 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a" returned: 0 in 0.478s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:22 devstack sudo[99091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a Sep 01 02:13:22 devstack sudo[99091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:22 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7ef0c089-cdca-4e16-9402-403928f7bf13" returned: 0 in 0.322s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Lock "cinder-quobyte-7ef0c089-cdca-4e16-9402-403928f7bf13" released by "delete_volume" :: held 0.986s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Created reservations ['1cf3b0e4-78e0-4225-b3f6-a6b1b0026368', 'e54000c1-78da-4bf0-b387-2a86ab67a20e', 'e7c3f6db-9d0e-463d-89ce-c5b126ee608b', 'ee0e839b-e307-48f3-b816-c0d14fba83c0'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:22 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:13:22 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:22 devstack sudo[99091]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c4730b89-e4a7-45cc-bc98-68955d917c2a" returned: 0 in 0.406s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Lock "cinder-quobyte-c4730b89-e4a7-45cc-bc98-68955d917c2a" released by "delete_volume" :: held 0.947s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Created reservations ['21d63850-10db-44cf-b61d-585aa2eec0d9', 'b69340ae-6ebf-416f-a350-d9a48d5c7888', 'fb969c83-1460-498e-be77-810da8cdbe80', '88958a19-a028-443d-842a-1e125501cd21'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:23 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:13:23 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:23 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.383s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:23 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:23 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Deleted volume successfully. Sep 01 02:13:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a4cd0b5-46ca-4b8f-9ba0-a96017e6263f tempest-VolumesExtendTest-3044692 None] Lock "cinder-7ef0c089-cdca-4e16-9402-403928f7bf13-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:23 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.348s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:23 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:23 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Deleted volume successfully. Sep 01 02:13:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3eebfb6-d142-4081-b2e4-49dc23a9f94a tempest-VolumeQuotasNegativeTestJSON-207591293 None] Lock "cinder-c4730b89-e4a7-45cc-bc98-68955d917c2a-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:25 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Flow 'volume_create_manager' (f56509f8-7179-4366-b640-9a97fddef821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ba992f-1533-4c3a-aa2e-9ec5b8643682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ba992f-1533-4c3a-aa2e-9ec5b8643682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452dde6f-cfaa-4332-8efa-663a1f17d49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c7d9b3585421a9ae1dbed59568582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:26Z,use_quota=True,user_id='a7861c4f65254896b425c0b32a05f133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4367407b-78e2-4600-9807-b4087dc9cead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4367407b-78e2-4600-9807-b4087dc9cead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a31343-740f-4d2d-b3a1-7f2f58672004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG cinder.image.glance [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Creating Keystone auth plugin from conf {{(pid=87389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09a31343-740f-4d2d-b3a1-7f2f58672004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '452dde6f-cfaa-4332-8efa-663a1f17d49d', 'volume_name': 'volume-452dde6f-cfaa-4332-8efa-663a1f17d49d', 'volume_size': 1, 'image_id': 'e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7745cb5420d9c149b12b1333badb1f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd08c7d9b3585421a9ae1dbed59568582', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1b6871785b21291e20dce84bb4a7f9870dc30247a11e1fb426cd6618f4bf67b1ddfe7f5cc1971c1c52702433a2bd33193fa8fb0400eec4bf70e756c6094a9d6f', 'id': 'e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'created_at': datetime.datetime(2026, 9, 1, 0, 13, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 13, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e891f461-2d13-4eb8-a8c0-2ec3f750f9a3/file', 'properties': {}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc3996b-947f-4c25-b8a3-bca9bc686b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc3996b-947f-4c25-b8a3-bca9bc686b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2439286a-7fad-4cb1-b577-0c39b1c1d997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:26 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Volume 452dde6f-cfaa-4332-8efa-663a1f17d49d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-452dde6f-cfaa-4332-8efa-663a1f17d49d', 'volume_size': 1, 'image_id': 'e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7745cb5420d9c149b12b1333badb1f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd08c7d9b3585421a9ae1dbed59568582', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1b6871785b21291e20dce84bb4a7f9870dc30247a11e1fb426cd6618f4bf67b1ddfe7f5cc1971c1c52702433a2bd33193fa8fb0400eec4bf70e756c6094a9d6f', 'id': 'e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'created_at': datetime.datetime(2026, 9, 1, 0, 13, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 13, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e891f461-2d13-4eb8-a8c0-2ec3f750f9a3/file', 'properties': {}}, 'image_service': } Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Trying to clone 452dde6f-cfaa-4332-8efa-663a1f17d49d from image e891f461-2d13-4eb8-a8c0-2ec3f750f9a3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'metadata': {}}]). {{(pid=87389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:13:26 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8098060a-3362-4a1e-ab64-6234f84299c7]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:27 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD Sep 01 02:13:27 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:27 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:27 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD Sep 01 02:13:27 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=166,cinder:INSERT=56,cinder:UPDATE=208,cinder:DELETE=17 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=170,cinder:UPDATE=206,cinder:DELETE=16,cinder:INSERT=56 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:27 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (e399e0ea-d195-4568-a09e-f16709dba83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251953ae-4f0c-405e-8c0d-b2e225b706d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD" returned: 1 in 0.608s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Temporary image e891f461-2d13-4eb8-a8c0-2ec3f750f9a3 is fetched for user a7861c4f65254896b425c0b32a05f133. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251953ae-4f0c-405e-8c0d-b2e225b706d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1492658766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f43e47-2b4b-4d26-9083-3c89263a16b6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:28Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadb080d-23fc-4db0-8e67-e1e7a944e3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fadb080d-23fc-4db0-8e67-e1e7a944e3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0883cfff-affb-4b15-8ab2-8b690ee9d52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0883cfff-affb-4b15-8ab2-8b690ee9d52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5f43e47-2b4b-4d26-9083-3c89263a16b6', 'volume_name': 'volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fc1c0b-aaec-4728-a98e-4dc1fa120e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fc1c0b-aaec-4728-a98e-4dc1fa120e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd748c3-7f9d-4b41-a4eb-dd5169fb9ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:28 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Volume d5f43e47-2b4b-4d26-9083-3c89263a16b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6', 'volume_size': 1} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1492658766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5f43e47-2b4b-4d26-9083-3c89263a16b6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:28Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Creating volume d5f43e47-2b4b-4d26-9083-3c89263a16b6 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:28 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:28 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6 1073741824 Sep 01 02:13:28 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f6430d-4bb3-47bf-8d1b-480b044005dd]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:28 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD Sep 01 02:13:28 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:28 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:28 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6 1073741824" returned: 0 in 0.693s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:28 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD Sep 01 02:13:28 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:28 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6 Sep 01 02:13:28 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:29 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6" returned: 0 in 0.317s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd748c3-7f9d-4b41-a4eb-dd5169fb9ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9851409c-4b55-4627-9b70-9b0f2486c6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:29 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Volume volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6 (d5f43e47-2b4b-4d26-9083-3c89263a16b6): created successfully Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9851409c-4b55-4627-9b70-9b0f2486c6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (e399e0ea-d195-4568-a09e-f16709dba83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:29 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD" returned: 1 in 0.582s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452dde6f-cfaa-4332-8efa-663a1f17d49d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08c7d9b3585421a9ae1dbed59568582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:26Z,use_quota=True,user_id='a7861c4f65254896b425c0b32a05f133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Creating volume 452dde6f-cfaa-4332-8efa-663a1f17d49d {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:29 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:29 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d 1073741824 Sep 01 02:13:29 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:29 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a36f8f01-4025-47f9-bb2b-0071c2b28e74 tempest-VolumesGetTest-2074814730 None] Created volume successfully. Sep 01 02:13:29 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d 1073741824" returned: 0 in 0.545s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:29 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d Sep 01 02:13:29 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:30 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d" returned: 0 in 0.469s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:30 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Attempting download of e891f461-2d13-4eb8-a8c0-2ec3f750f9a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'metadata': {}}])) to volume 452dde6f-cfaa-4332-8efa-663a1f17d49d. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:13:30 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5dded6-61da-4ad9-a789-4c9cfbb109cd]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_u2czdgt7 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:30 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_u2czdgt7 Sep 01 02:13:30 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:30 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_u2czdgt7" returned: 0 in 0.422s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_u2czdgt7 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:30 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_u2czdgt7 Sep 01 02:13:30 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (88dac708-8d41-42a3-a24d-ea073d3d7f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66340c79-a08a-409a-b130-af8a76d1fc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66340c79-a08a-409a-b130-af8a76d1fc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-563522919',display_name='tempest-VolumesGetTest-Volume-1746803788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c1258a-d20f-44e5-97e1-55995cdec109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:31Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8e41c4-c8f4-42a8-96e1-d971d27b4e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8e41c4-c8f4-42a8-96e1-d971d27b4e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691b1feb-3c7a-437c-847f-d3be592a66d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691b1feb-3c7a-437c-847f-d3be592a66d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c1258a-d20f-44e5-97e1-55995cdec109', 'volume_name': 'volume-47c1258a-d20f-44e5-97e1-55995cdec109', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90d9d07-9122-47bf-acd1-84be15010c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d90d9d07-9122-47bf-acd1-84be15010c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61c339e-c988-48a6-b118-52ee37c57df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:31 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Volume 47c1258a-d20f-44e5-97e1-55995cdec109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c1258a-d20f-44e5-97e1-55995cdec109', 'volume_size': 1} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-563522919',display_name='tempest-VolumesGetTest-Volume-1746803788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c1258a-d20f-44e5-97e1-55995cdec109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:31Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Creating volume 47c1258a-d20f-44e5-97e1-55995cdec109 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:31 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:31 devstack sudo[99182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109 1073741824 Sep 01 02:13:31 devstack sudo[99182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:31 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_u2czdgt7" returned: 1 in 0.464s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_u2czdgt7' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[78494bf3-6298-411d-84ab-18480410fec2]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:31 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD Sep 01 02:13:31 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:31 devstack sudo[99182]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109 1073741824" returned: 0 in 0.587s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:31 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:31 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109 Sep 01 02:13:31 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:31 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD Sep 01 02:13:31 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD" returned: 1 in 0.462s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] e891f461-2d13-4eb8-a8c0-2ec3f750f9a3 was raw, converting to qcow2 {{(pid=87389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109" returned: 0 in 0.464s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:32 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d Sep 01 02:13:32 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a61c339e-c988-48a6-b118-52ee37c57df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c1258a-d20f-44e5-97e1-55995cdec109', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838c45c8-556f-4269-9726-fbced9d02c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:32 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Volume volume-47c1258a-d20f-44e5-97e1-55995cdec109 (47c1258a-d20f-44e5-97e1-55995cdec109): created successfully Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (838c45c8-556f-4269-9726-fbced9d02c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (88dac708-8d41-42a3-a24d-ea073d3d7f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:32 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-43d375ba-4bff-4a65-9bed-da4f0863fab7 tempest-VolumesGetTest-2074814730 None] Created volume successfully. Sep 01 02:13:32 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d" returned: 0 in 0.662s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e891f461-2d13-4eb8-a8c0-2ec3f750f9a3_weorletudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:13:32 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:13:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:32 devstack sudo[99208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d 1G Sep 01 02:13:32 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d 1G" returned: 0 in 0.396s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Downloaded image e891f461-2d13-4eb8-a8c0-2ec3f750f9a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'metadata': {}}])) to volume 452dde6f-cfaa-4332-8efa-663a1f17d49d successfully. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Temporary image e891f461-2d13-4eb8-a8c0-2ec3f750f9a3 for user a7861c4f65254896b425c0b32a05f133 is deleted. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Marking volume 452dde6f-cfaa-4332-8efa-663a1f17d49d as bootable. {{(pid=87389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-47c1258a-d20f-44e5-97e1-55995cdec109-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Copying metadata from image e891f461-2d13-4eb8-a8c0-2ec3f750f9a3 to 452dde6f-cfaa-4332-8efa-663a1f17d49d. {{(pid=87389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Creating volume glance metadata for volume 452dde6f-cfaa-4332-8efa-663a1f17d49d backed by image e891f461-2d13-4eb8-a8c0-2ec3f750f9a3 with: {'image_id': 'e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c7745cb5420d9c149b12b1333badb1f6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Lock "cinder-47c1258a-d20f-44e5-97e1-55995cdec109-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-quobyte-47c1258a-d20f-44e5-97e1-55995cdec109" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-47c1258a-d20f-44e5-97e1-55995cdec109" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2439286a-7fad-4cb1-b577-0c39b1c1d997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452dde6f-cfaa-4332-8efa-663a1f17d49d', 'volume_size': 1, 'image_id': 'e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c7745cb5420d9c149b12b1333badb1f6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd08c7d9b3585421a9ae1dbed59568582', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1b6871785b21291e20dce84bb4a7f9870dc30247a11e1fb426cd6618f4bf67b1ddfe7f5cc1971c1c52702433a2bd33193fa8fb0400eec4bf70e756c6094a9d6f', 'id': 'e891f461-2d13-4eb8-a8c0-2ec3f750f9a3', 'created_at': datetime.datetime(2026, 9, 1, 0, 13, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 13, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e891f461-2d13-4eb8-a8c0-2ec3f750f9a3/file', 'properties': {}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a67c0e0-4cb4-4abd-9c93-0a973292e550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c42325-8a5c-45d8-b78d-54b23ca05529]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Volume volume-452dde6f-cfaa-4332-8efa-663a1f17d49d (452dde6f-cfaa-4332-8efa-663a1f17d49d): created successfully Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a67c0e0-4cb4-4abd-9c93-0a973292e550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Flow 'volume_create_manager' (f56509f8-7179-4366-b640-9a97fddef821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:33 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-24b23588-4d77-4fbe-8bf9-541f583dae9b tempest-VolumeImageDependencyTests-1725841335 None] Created volume successfully. Sep 01 02:13:33 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109 Sep 01 02:13:33 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Acquiring lock "cinder-452dde6f-cfaa-4332-8efa-663a1f17d49d-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Lock "cinder-452dde6f-cfaa-4332-8efa-663a1f17d49d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Acquiring lock "cinder-quobyte-452dde6f-cfaa-4332-8efa-663a1f17d49d" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Lock "cinder-quobyte-452dde6f-cfaa-4332-8efa-663a1f17d49d" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[772c9d21-729a-4c70-8622-2b3ea210912e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:33 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109" returned: 0 in 0.523s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:34 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109 Sep 01 02:13:34 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:34 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d Sep 01 02:13:34 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:34 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-47c1258a-d20f-44e5-97e1-55995cdec109" returned: 0 in 0.274s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-47c1258a-d20f-44e5-97e1-55995cdec109" released by "delete_volume" :: held 0.854s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Created reservations ['df7f925e-b9ab-4e21-a93a-186c2e31d15e', '1395a558-f8b4-4ee8-b921-e2138156f13c', '15ff3bef-43e8-48c8-949e-66b3297795b6', '62435fac-e57a-4509-99a8-93126ef3728b'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:34 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:34 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:13:34 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d" returned: 0 in 0.533s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:34 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d Sep 01 02:13:34 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-d5f43e47-2b4b-4d26-9083-3c89263a16b6-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Lock "cinder-d5f43e47-2b4b-4d26-9083-3c89263a16b6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:34 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-quobyte-d5f43e47-2b4b-4d26-9083-3c89263a16b6" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.341s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:34 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Deleted volume successfully. Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-d5f43e47-2b4b-4d26-9083-3c89263a16b6" acquired by "delete_volume" :: waited 0.036s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0af167ad-df68-427f-88f4-2955571c1707 tempest-VolumesGetTest-2074814730 None] Lock "cinder-47c1258a-d20f-44e5-97e1-55995cdec109-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cf9e25-daa7-4460-8822-401cd9ddf38a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:34 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-452dde6f-cfaa-4332-8efa-663a1f17d49d" returned: 0 in 0.434s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Lock "cinder-quobyte-452dde6f-cfaa-4332-8efa-663a1f17d49d" released by "delete_volume" :: held 1.041s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:35 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6 Sep 01 02:13:35 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Created reservations ['d7eaf458-0782-4d83-aefc-0b05504480b1', '9fe1d1a5-6524-40ee-a5ef-86feb0df8131', 'a218aec9-7fc1-401b-aa4e-04834c7becab', '2fdbe73a-0e20-4a00-8733-e44a3215dee6'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:35 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:13:35 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:35 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6" returned: 0 in 0.589s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:35 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6 Sep 01 02:13:35 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:35 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.365s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:35 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Deleted volume successfully. Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-630b2f52-a2f5-4433-9809-363e3e8f9890 tempest-VolumeImageDependencyTests-1725841335 None] Lock "cinder-452dde6f-cfaa-4332-8efa-663a1f17d49d-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:35 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d5f43e47-2b4b-4d26-9083-3c89263a16b6" returned: 0 in 0.347s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-d5f43e47-2b4b-4d26-9083-3c89263a16b6" released by "delete_volume" :: held 1.020s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Created reservations ['3232c343-bacb-4b45-8e76-478f2482d3ce', '073d6c00-c52b-48b3-a899-3fc389b30c56', '201573df-bb27-4f30-873b-0144a5002081', '11429633-f0d6-4381-8cd8-f87eb5996409'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:36 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:13:36 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:36 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.286s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:36 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:36 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Deleted volume successfully. Sep 01 02:13:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-53db5c9f-1ac0-4034-bcff-eaffc72b89cd tempest-VolumesGetTest-2074814730 None] Lock "cinder-d5f43e47-2b4b-4d26-9083-3c89263a16b6-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (8892694d-3cff-4687-b84c-bdf27fbdeab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519591a7-b420-4b74-9b83-2d233d5754c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (519591a7-b420-4b74-9b83-2d233d5754c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-774806115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9b4073-5606-48e0-a2e4-18001dff8c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:38Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9127353b-fcdc-4774-9016-3b135c567fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9127353b-fcdc-4774-9016-3b135c567fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e758b4c-89d8-4f1a-b8ce-f2c382148720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e758b4c-89d8-4f1a-b8ce-f2c382148720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa9b4073-5606-48e0-a2e4-18001dff8c3c', 'volume_name': 'volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d52871c-751e-43cb-9b96-84191a6252a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d52871c-751e-43cb-9b96-84191a6252a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814c83b1-6f06-4163-a8ca-f9f8a9ad3012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:37 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Volume fa9b4073-5606-48e0-a2e4-18001dff8c3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c', 'volume_size': 1} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-774806115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9b4073-5606-48e0-a2e4-18001dff8c3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:38Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Creating volume fa9b4073-5606-48e0-a2e4-18001dff8c3c {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:37 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:13:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:37 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c 1073741824 Sep 01 02:13:37 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:38 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c 1073741824" returned: 0 in 0.650s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:38 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c Sep 01 02:13:38 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:38 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c" returned: 0 in 0.354s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814c83b1-6f06-4163-a8ca-f9f8a9ad3012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dfb9a6-467c-4fbb-b59f-c060f4daccd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:38 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Volume volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c (fa9b4073-5606-48e0-a2e4-18001dff8c3c): created successfully Sep 01 02:13:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1dfb9a6-467c-4fbb-b59f-c060f4daccd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (8892694d-3cff-4687-b84c-bdf27fbdeab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:38 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-483034af-4695-45b4-a827-81661cd52a11 tempest-VolumesGetTest-2074814730 None] Created volume successfully. Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (8b0cb56f-a0a0-41f7-b8c4-814e310887b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6a5149-a304-4954-b7bb-7b32b5a23b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af6a5149-a304-4954-b7bb-7b32b5a23b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1816182310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d3cc054-f56a-4c11-b394-1fbb13210946,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fa9b4073-5606-48e0-a2e4-18001dff8c3c,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:41Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1105ccb-b47f-4317-a7fd-ad4646d2b03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1105ccb-b47f-4317-a7fd-ad4646d2b03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0cb299-c6aa-4eb7-aa82-4da7fe7ddf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0cb299-c6aa-4eb7-aa82-4da7fe7ddf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1d3cc054-f56a-4c11-b394-1fbb13210946', 'volume_name': 'volume-1d3cc054-f56a-4c11-b394-1fbb13210946', 'volume_size': 1, 'source_volid': 'fa9b4073-5606-48e0-a2e4-18001dff8c3c', 'source_volstatus': 'available'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98975954-28a3-4b87-aebf-2e0470a25621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98975954-28a3-4b87-aebf-2e0470a25621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4cfd2a-0add-43af-a428-2efd371c8f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:40 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Volume 1d3cc054-f56a-4c11-b394-1fbb13210946: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1d3cc054-f56a-4c11-b394-1fbb13210946', 'volume_size': 1, 'source_volid': 'fa9b4073-5606-48e0-a2e4-18001dff8c3c', 'source_volstatus': 'available'} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:40 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Cloning volume fa9b4073-5606-48e0-a2e4-18001dff8c3c to volume 1d3cc054-f56a-4c11-b394-1fbb13210946 Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Creating offline snapshot c834550a-e7f6-49be-b9c7-4d4591b55a3b of volume fa9b4073-5606-48e0-a2e4-18001dff8c3c {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[97102384-3d34-44d8-a137-13cae1786a10]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:41 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c Sep 01 02:13:41 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:41 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c" returned: 0 in 0.736s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:41 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b 1G Sep 01 02:13:41 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:42 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b 1G" returned: 0 in 0.729s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:42 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b Sep 01 02:13:42 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:42 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b" returned: 0 in 0.498s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:42 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b is being set with open permissions: ugo+rw Sep 01 02:13:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:42 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b Sep 01 02:13:42 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:43 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b" returned: 0 in 0.540s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:43 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.info Sep 01 02:13:43 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:43 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.info" returned: 0 in 0.430s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:43 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.info is being set with open permissions: ugo+rw Sep 01 02:13:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:43 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.info Sep 01 02:13:43 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:44 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.info" returned: 0 in 0.472s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-quobyte-1d3cc054-f56a-4c11-b394-1fbb13210946" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-1d3cc054-f56a-4c11-b394-1fbb13210946" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] snapshot: c834550a-e7f6-49be-b9c7-4d4591b55a3b, volume: 1d3cc054-f56a-4c11-b394-1fbb13210946, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:13:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ddcb6-7f01-41a9-b723-ef608475ffd3]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:44 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b Sep 01 02:13:44 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:45 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b" returned: 0 in 0.577s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:45 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[53610821-a5e3-4c1a-a073-2e2ece0cf8c7]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:45 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c Sep 01 02:13:45 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:45 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c" returned: 0 in 0.544s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:13:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:13:45 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946 not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:13:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:45 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946 Sep 01 02:13:45 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:13:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:47 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:13:47 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:48 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.834s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:48 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:13:48 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:13:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:13:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:13:51 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946" returned: 0 in 6.051s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:51 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946 {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:13:51 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Converted 1024.00 MB image at 169.20 MB/s Sep 01 02:13:51 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946 is being set with open permissions: ugo+rw Sep 01 02:13:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:51 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946 Sep 01 02:13:51 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:52 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946" returned: 0 in 0.343s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-1d3cc054-f56a-4c11-b394-1fbb13210946" released by "_copy_volume_from_snapshot" :: held 7.659s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-quobyte-c834550a-e7f6-49be-b9c7-4d4591b55a3b" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-c834550a-e7f6-49be-b9c7-4d4591b55a3b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Deleting offline snapshot c834550a-e7f6-49be-b9c7-4d4591b55a3b of volume fa9b4073-5606-48e0-a2e4-18001dff8c3c {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] snapshot_file for this snap is: volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e509ea-315a-476a-a4e5-e40d3ee01a4d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:52 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b Sep 01 02:13:52 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:52 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b" returned: 0 in 0.514s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5332b356-e75e-4df4-831e-550cc0b52d2d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:52 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c Sep 01 02:13:52 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:53 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c" returned: 0 in 0.574s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:53 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b Sep 01 02:13:53 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:53 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=35,cinder:INSERT=12,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:13:53 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b" returned: 0 in 0.403s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:53 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b Sep 01 02:13:53 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:54 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c.c834550a-e7f6-49be-b9c7-4d4591b55a3b" returned: 0 in 0.283s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-c834550a-e7f6-49be-b9c7-4d4591b55a3b" released by "_delete_snapshot" :: held 1.931s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.375s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b4cfd2a-0add-43af-a428-2efd371c8f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d3cc054-f56a-4c11-b394-1fbb13210946', 'volume_size': 1, 'source_volid': 'fa9b4073-5606-48e0-a2e4-18001dff8c3c', 'source_volstatus': 'available'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497035ab-66b8-4249-9080-e1bab3f61fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:54 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Volume volume-1d3cc054-f56a-4c11-b394-1fbb13210946 (1d3cc054-f56a-4c11-b394-1fbb13210946): created successfully Sep 01 02:13:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (497035ab-66b8-4249-9080-e1bab3f61fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (8b0cb56f-a0a0-41f7-b8c4-814e310887b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:54 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-21320a72-5c4a-4fc8-b66f-9c66baa93755 tempest-VolumesGetTest-2074814730 None] Created volume successfully. Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (a51cd833-df23-4d23-b6b6-cdbf80f01188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124cf54c-3bcb-46b0-8f03-4c6792c5a421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124cf54c-3bcb-46b0-8f03-4c6792c5a421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-898746285',display_name='tempest-VolumesGetTest-Volume-5188507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf9677f-2a6d-4e60-8caf-d05fd9e17925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:56Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4fc89e-f962-44bc-8b24-ea660aa064bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f4fc89e-f962-44bc-8b24-ea660aa064bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3664781-c1c3-4d0c-8ebc-721c79018280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3664781-c1c3-4d0c-8ebc-721c79018280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf9677f-2a6d-4e60-8caf-d05fd9e17925', 'volume_name': 'volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8c8784-4a38-48c9-8faf-dc907aa7f8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a8c8784-4a38-48c9-8faf-dc907aa7f8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147cb04e-77ee-4148-98e9-957c6b57a1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:56 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Volume caf9677f-2a6d-4e60-8caf-d05fd9e17925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925', 'volume_size': 1} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:13:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-898746285',display_name='tempest-VolumesGetTest-Volume-5188507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf9677f-2a6d-4e60-8caf-d05fd9e17925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:13:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:13:56Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Creating volume caf9677f-2a6d-4e60-8caf-d05fd9e17925 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:13:56 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:13:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:56 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925 1073741824 Sep 01 02:13:56 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:57 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925 1073741824" returned: 0 in 0.659s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:57 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925 Sep 01 02:13:57 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:57 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925" returned: 0 in 0.398s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:13:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147cb04e-77ee-4148-98e9-957c6b57a1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb676cc2-0678-4d78-b5ef-9512de0b3042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:13:57 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Volume volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925 (caf9677f-2a6d-4e60-8caf-d05fd9e17925): created successfully Sep 01 02:13:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb676cc2-0678-4d78-b5ef-9512de0b3042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:13:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (a51cd833-df23-4d23-b6b6-cdbf80f01188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:13:57 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-dce884a5-9f27-4a1f-b8a9-86d2ce7a648a tempest-VolumesGetTest-2074814730 None] Created volume successfully. Sep 01 02:13:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-caf9677f-2a6d-4e60-8caf-d05fd9e17925-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Lock "cinder-caf9677f-2a6d-4e60-8caf-d05fd9e17925-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-quobyte-caf9677f-2a6d-4e60-8caf-d05fd9e17925" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:13:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-caf9677f-2a6d-4e60-8caf-d05fd9e17925" acquired by "delete_volume" :: waited 0.031s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:13:58 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5921aa4a-8cf9-44a9-af2c-1cf2f42c2dd3]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:13:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:58 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925 Sep 01 02:13:58 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:59 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925" returned: 0 in 0.509s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:59 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925 Sep 01 02:13:59 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:13:59 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 01 02:13:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-caf9677f-2a6d-4e60-8caf-d05fd9e17925" returned: 0 in 0.327s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:13:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-caf9677f-2a6d-4e60-8caf-d05fd9e17925" released by "delete_volume" :: held 0.898s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:13:59 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Created reservations ['e5faf6fd-4af5-4c31-9391-282edf6de7f4', '5142f25d-6f3b-4054-9acb-a8ade5d4088c', '7175dd1c-7366-4521-9e10-d463766fa932', '629bba24-b8b3-4c9d-9c17-4cb0a7c2db7b'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:13:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:13:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:13:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:13:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:13:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:13:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:13:59 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:13:59 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-1d3cc054-f56a-4c11-b394-1fbb13210946-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Lock "cinder-1d3cc054-f56a-4c11-b394-1fbb13210946-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-quobyte-1d3cc054-f56a-4c11-b394-1fbb13210946" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-1d3cc054-f56a-4c11-b394-1fbb13210946" acquired by "delete_volume" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:00 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[934f4942-e8db-4073-afb2-38ceabb1eee3]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:00 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.551s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:00 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Deleted volume successfully. Sep 01 02:14:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-52f40fac-123c-4540-984f-d9d799c281a7 tempest-VolumesGetTest-2074814730 None] Lock "cinder-caf9677f-2a6d-4e60-8caf-d05fd9e17925-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:00 devstack sudo[99358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946 Sep 01 02:14:00 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:00 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946" returned: 0 in 0.492s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:00 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946 Sep 01 02:14:00 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:01 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1d3cc054-f56a-4c11-b394-1fbb13210946" returned: 0 in 0.373s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-1d3cc054-f56a-4c11-b394-1fbb13210946" released by "delete_volume" :: held 0.954s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Created reservations ['6171eb53-e8f6-4982-9da4-f2e17a4ded0c', '7182e508-24f9-403e-ab40-122f17b36d71', '2e610daa-c2d7-4e9e-901a-8f58b7f92f7b', '28a0be86-2fde-4944-8f75-1992b5cc3f56'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:01 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:14:01 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:01 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.298s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:01 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Deleted volume successfully. Sep 01 02:14:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bd31bcc2-880d-4b5b-94e3-71dcce93b256 tempest-VolumesGetTest-2074814730 None] Lock "cinder-1d3cc054-f56a-4c11-b394-1fbb13210946-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-fa9b4073-5606-48e0-a2e4-18001dff8c3c-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Lock "cinder-fa9b4073-5606-48e0-a2e4-18001dff8c3c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-quobyte-fa9b4073-5606-48e0-a2e4-18001dff8c3c" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-fa9b4073-5606-48e0-a2e4-18001dff8c3c" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:02 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62dbf77-0cd3-4f36-ba8c-714ef4157f09]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:02 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c Sep 01 02:14:02 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:03 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c" returned: 0 in 0.503s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:03 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c Sep 01 02:14:03 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:03 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-fa9b4073-5606-48e0-a2e4-18001dff8c3c" returned: 0 in 0.317s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-fa9b4073-5606-48e0-a2e4-18001dff8c3c" released by "delete_volume" :: held 0.899s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:03 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Created reservations ['f0503e0c-81ce-41cf-86e8-2cb3dc69145d', '9d4a823b-5503-449b-a6cb-8be75900a777', '2409d4da-08ae-40fb-ac5d-4056d9de3af3', '6773e829-3d54-4a76-8dd5-64664b6a4419'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:03 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:14:03 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:04 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.497s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:04 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:04 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Deleted volume successfully. Sep 01 02:14:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e76019e-261c-418e-b983-51c100cefcc6 tempest-VolumesGetTest-2074814730 None] Lock "cinder-fa9b4073-5606-48e0-a2e4-18001dff8c3c-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (d2542a93-8b29-4b58-b569-3af1e215b55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e9f7c6-197e-4d3f-b0a3-bdae6164fdfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e9f7c6-197e-4d3f-b0a3-bdae6164fdfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-939409590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9581e002-87a8-47c2-b85f-8fc156363388,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:05Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227ef8b6-68a4-4b70-bd6f-bf0338709df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (227ef8b6-68a4-4b70-bd6f-bf0338709df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12661726-ac54-48cc-92f3-9e6c937b4fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.image.glance [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Creating Keystone auth plugin from conf {{(pid=87389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12661726-ac54-48cc-92f3-9e6c937b4fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9581e002-87a8-47c2-b85f-8fc156363388', 'volume_name': 'volume-9581e002-87a8-47c2-b85f-8fc156363388', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f8aee9-e252-4f19-8266-7404dc6f41ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f8aee9-e252-4f19-8266-7404dc6f41ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfbd028b-8eda-4b73-9812-da5d872d7379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:05 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Volume 9581e002-87a8-47c2-b85f-8fc156363388: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9581e002-87a8-47c2-b85f-8fc156363388', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:14:05 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Trying to clone 9581e002-87a8-47c2-b85f-8fc156363388 from image 97f1460d-e99d-469e-a933-615f59c7b55c at location (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]). {{(pid=87389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:14:06 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:14:06 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:14:06 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[46942f2b-54bb-46a5-b237-176dbe55be66]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:06 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD Sep 01 02:14:06 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:06 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD" returned: 0 in 0.486s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:06 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Temporary image 97f1460d-e99d-469e-a933-615f59c7b55c is fetched for user a57e42caa3cd41dbb108faf25e045ad3. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:14:06 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ae8457-c886-4ae5-be79-f79ae645cedb]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:07 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD Sep 01 02:14:07 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:07 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-939409590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9581e002-87a8-47c2-b85f-8fc156363388,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:05Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Creating volume 9581e002-87a8-47c2-b85f-8fc156363388 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:07 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:14:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:07 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 1073741824 Sep 01 02:14:07 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:08 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 1073741824" returned: 0 in 0.653s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:08 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 Sep 01 02:14:08 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:08 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388" returned: 0 in 0.354s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:08 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Attempting download of 97f1460d-e99d-469e-a933-615f59c7b55c ((None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}])) to volume 9581e002-87a8-47c2-b85f-8fc156363388. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:14:08 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a050dc-bb48-40e3-82d8-327d0928f275]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_2e1km8zb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:08 devstack sudo[99421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_2e1km8zb Sep 01 02:14:08 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:08 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_2e1km8zb" returned: 0 in 0.448s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_2e1km8zb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:09 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_2e1km8zb Sep 01 02:14:09 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:09 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_2e1km8zb" returned: 1 in 0.346s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_2e1km8zb' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:14:09 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9735fc-2f44-445f-9f68-bab9596a590d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:09 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD Sep 01 02:14:09 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:09 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:09 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] 97f1460d-e99d-469e-a933-615f59c7b55c was qcow2, converting to qcow2 {{(pid=87389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:14:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:09 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 Sep 01 02:14:09 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:12 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388" returned: 0 in 2.769s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:12 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_wzcijyl2devstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:14:12 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Converted 112.00 MB image at 40.43 MB/s Sep 01 02:14:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:12 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 1G Sep 01 02:14:12 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:13 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 1G" returned: 0 in 0.790s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:13 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Downloaded image 97f1460d-e99d-469e-a933-615f59c7b55c ((None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}])) to volume 9581e002-87a8-47c2-b85f-8fc156363388 successfully. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:14:13 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Temporary image 97f1460d-e99d-469e-a933-615f59c7b55c for user a57e42caa3cd41dbb108faf25e045ad3 is deleted. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:14:13 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Marking volume 9581e002-87a8-47c2-b85f-8fc156363388 as bootable. {{(pid=87389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:14:13 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Copying metadata from image 97f1460d-e99d-469e-a933-615f59c7b55c to 9581e002-87a8-47c2-b85f-8fc156363388. {{(pid=87389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:14:13 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Creating volume glance metadata for volume 9581e002-87a8-47c2-b85f-8fc156363388 backed by image 97f1460d-e99d-469e-a933-615f59c7b55c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:14:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfbd028b-8eda-4b73-9812-da5d872d7379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9581e002-87a8-47c2-b85f-8fc156363388', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e104491-8e47-42e4-b01f-9e73371eae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:13 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Volume volume-9581e002-87a8-47c2-b85f-8fc156363388 (9581e002-87a8-47c2-b85f-8fc156363388): created successfully Sep 01 02:14:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e104491-8e47-42e4-b01f-9e73371eae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (d2542a93-8b29-4b58-b569-3af1e215b55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:13 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4924b989-a4b9-4a65-9810-8d1cb1246f8d tempest-VolumesGetTest-2074814730 None] Created volume successfully. Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (5591d6c6-0379-469a-b9c8-77da1f4ecee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e901a7f0-254d-4939-a03d-c6bbc6916031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e901a7f0-254d-4939-a03d-c6bbc6916031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1799120323',display_name='tempest-VolumesGetTest-Volume-1812032112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52c3fe4-2eda-40f8-a060-dc853ef13a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:16Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e069ddba-76db-4812-8627-a078d4264c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e069ddba-76db-4812-8627-a078d4264c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c921044c-f107-42b1-939c-b4a13dadf476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c921044c-f107-42b1-939c-b4a13dadf476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c52c3fe4-2eda-40f8-a060-dc853ef13a51', 'volume_name': 'volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2dc7a8-1cac-4254-9654-1da77656fa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad2dc7a8-1cac-4254-9654-1da77656fa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd4fcd6-f728-45c3-995e-7f14c6f84b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:15 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Volume c52c3fe4-2eda-40f8-a060-dc853ef13a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51', 'volume_size': 1} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1799120323',display_name='tempest-VolumesGetTest-Volume-1812032112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c52c3fe4-2eda-40f8-a060-dc853ef13a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ad2052f1e9460cb952bbff104b318a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:16Z,use_quota=True,user_id='a57e42caa3cd41dbb108faf25e045ad3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Creating volume c52c3fe4-2eda-40f8-a060-dc853ef13a51 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:15 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:14:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:15 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51 1073741824 Sep 01 02:14:15 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (8b33f247-248a-483d-9650-0077e83b6435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d40d16e-dc99-4916-ab4e-5863c4b493df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d40d16e-dc99-4916-ab4e-5863c4b493df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439679435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbda363b-a1e7-4a4b-8fc7-6725ac88fecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:16Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8a7162-bed5-4b52-a38b-7fa1cc487078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc8a7162-bed5-4b52-a38b-7fa1cc487078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266fd977-ef4d-4eca-b6a4-677277d23833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (266fd977-ef4d-4eca-b6a4-677277d23833) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbda363b-a1e7-4a4b-8fc7-6725ac88fecd', 'volume_name': 'volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5382b9-5a3b-4401-bc12-0acef3ffe800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5382b9-5a3b-4401-bc12-0acef3ffe800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3f49e7-a317-4e1b-a723-9880d55edef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:16 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Volume cbda363b-a1e7-4a4b-8fc7-6725ac88fecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd', 'volume_size': 1} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:16 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51 1073741824" returned: 0 in 0.938s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:16 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51 Sep 01 02:14:16 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:17 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51" returned: 0 in 0.355s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1439679435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbda363b-a1e7-4a4b-8fc7-6725ac88fecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:16Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Creating volume cbda363b-a1e7-4a4b-8fc7-6725ac88fecd {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:17 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd4fcd6-f728-45c3-995e-7f14c6f84b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:17 devstack sudo[99535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd 1073741824 Sep 01 02:14:17 devstack sudo[99535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758faaa1-05a9-4433-9f17-c7c3659f7617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:17 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Volume volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51 (c52c3fe4-2eda-40f8-a060-dc853ef13a51): created successfully Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758faaa1-05a9-4433-9f17-c7c3659f7617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Flow 'volume_create_manager' (5591d6c6-0379-469a-b9c8-77da1f4ecee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:17 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0e03f7c4-3c67-48b3-ba52-a97dbdb49584 tempest-VolumesGetTest-2074814730 None] Created volume successfully. Sep 01 02:14:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-c52c3fe4-2eda-40f8-a060-dc853ef13a51-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Lock "cinder-c52c3fe4-2eda-40f8-a060-dc853ef13a51-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-quobyte-c52c3fe4-2eda-40f8-a060-dc853ef13a51" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:18 devstack sudo[99535]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd 1073741824" returned: 0 in 0.755s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-c52c3fe4-2eda-40f8-a060-dc853ef13a51" acquired by "delete_volume" :: waited 0.048s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[670e6069-e068-4b84-8832-73998a29ea90]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:18 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd Sep 01 02:14:18 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:18 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51 Sep 01 02:14:18 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Flow 'volume_create_manager' (f5bc5ed3-60b1-4050-b1d3-5aa902e4343f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc34ec1-8d3c-4c67-bfcc-1fbbec6674ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bc34ec1-8d3c-4c67-bfcc-1fbbec6674ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-977616928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b36448-a708-4af4-82cc-61965e5d6daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a8a13f93c66400684603be81c437af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:18Z,use_quota=True,user_id='91a1f1beff5d48288878bf7a1f4d5627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:18 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28afcb8-3b71-4f6a-bdde-9b8b0ecbd140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28afcb8-3b71-4f6a-bdde-9b8b0ecbd140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4e67e9-964a-4a20-a492-a7c9d15836ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4e67e9-964a-4a20-a492-a7c9d15836ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6b36448-a708-4af4-82cc-61965e5d6daf', 'volume_name': 'volume-f6b36448-a708-4af4-82cc-61965e5d6daf', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e72d39-143f-47ea-b4ac-197769982f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e72d39-143f-47ea-b4ac-197769982f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c96691-c6ba-4ced-8776-0490fc378a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:18 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Volume f6b36448-a708-4af4-82cc-61965e5d6daf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6b36448-a708-4af4-82cc-61965e5d6daf', 'volume_size': 1} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd" returned: 0 in 0.377s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-977616928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6b36448-a708-4af4-82cc-61965e5d6daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a8a13f93c66400684603be81c437af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:18Z,use_quota=True,user_id='91a1f1beff5d48288878bf7a1f4d5627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Creating volume f6b36448-a708-4af4-82cc-61965e5d6daf {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:18 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:18 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51" returned: 0 in 0.431s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:18 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf 1073741824 Sep 01 02:14:18 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e3f49e7-a317-4e1b-a723-9880d55edef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08aa4cae-7e7e-4da8-9cb1-a7ba403e9ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:18 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51 Sep 01 02:14:18 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:18 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Volume volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd (cbda363b-a1e7-4a4b-8fc7-6725ac88fecd): created successfully Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08aa4cae-7e7e-4da8-9cb1-a7ba403e9ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (8b33f247-248a-483d-9650-0077e83b6435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:18 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d1fbc764-bd83-4872-a0cc-3a017bd60ab8 tempest-VolumesActionsTest-1668895119 None] Created volume successfully. Sep 01 02:14:18 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c52c3fe4-2eda-40f8-a060-dc853ef13a51" returned: 0 in 0.306s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-c52c3fe4-2eda-40f8-a060-dc853ef13a51" released by "delete_volume" :: held 0.813s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:18 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Created reservations ['d4539736-ec42-48c0-895b-138c1097ed40', 'ccd7e689-6463-46dd-a491-4e48fe66f546', 'fda8fa66-5ae8-47cd-8a33-9674a6dcb651', '84e4515a-7583-4b8d-a5ea-cb624a866354'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:19 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf 1073741824" returned: 0 in 0.504s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:14:19 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:19 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf Sep 01 02:14:19 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-9581e002-87a8-47c2-b85f-8fc156363388-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Lock "cinder-9581e002-87a8-47c2-b85f-8fc156363388-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b3eeab98-4f77-421d-895f-d8a8e779e480 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd" by "attach_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Acquiring lock "cinder-quobyte-9581e002-87a8-47c2-b85f-8fc156363388" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b3eeab98-4f77-421d-895f-d8a8e779e480 tempest-VolumesActionsTest-1668895119 None] Lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd" acquired by "attach_volume" :: waited 0.035s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:19 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-9581e002-87a8-47c2-b85f-8fc156363388" acquired by "delete_volume" :: waited 0.051s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:19 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf" returned: 0 in 0.426s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.499s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbcfb77-72c5-4847-b38a-e9f3a8bb773e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Deleted volume successfully. Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c96691-c6ba-4ced-8776-0490fc378a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6b36448-a708-4af4-82cc-61965e5d6daf', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6064005-6b8c-4cc9-8549-acc9c3a31974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:19 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Volume volume-f6b36448-a708-4af4-82cc-61965e5d6daf (f6b36448-a708-4af4-82cc-61965e5d6daf): created successfully Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6064005-6b8c-4cc9-8549-acc9c3a31974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Flow 'volume_create_manager' (f5bc5ed3-60b1-4050-b1d3-5aa902e4343f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d4efb17-dcf0-4355-bdea-3c841f55e3e4 tempest-VolumesGetTest-2074814730 None] Lock "cinder-c52c3fe4-2eda-40f8-a060-dc853ef13a51-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b3eeab98-4f77-421d-895f-d8a8e779e480 tempest-VolumesActionsTest-1668895119 None] Attaching volume cbda363b-a1e7-4a4b-8fc7-6725ac88fecd to instance d625b8e8-1dfb-4636-b8bc-388fb2bb853a at mountpoint /dev/vdb on host None. Sep 01 02:14:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fb8a619e-7b28-47a2-9ac2-c5251f94bd63 tempest-TestImageHashVerification-416462312 None] Created volume successfully. Sep 01 02:14:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b3eeab98-4f77-421d-895f-d8a8e779e480 tempest-VolumesActionsTest-1668895119 None] Attach volume completed successfully. Sep 01 02:14:19 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 Sep 01 02:14:19 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b3eeab98-4f77-421d-895f-d8a8e779e480 tempest-VolumesActionsTest-1668895119 None] Lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd" released by "attach_volume" :: held 0.197s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:19 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388" returned: 0 in 0.408s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:20 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388 Sep 01 02:14:20 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0b5d433e-6a09-4541-bdd4-56fc1992ba02 tempest-VolumesActionsTest-1273129180 None] Terminate volume connection completed successfully. Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0b5d433e-6a09-4541-bdd4-56fc1992ba02 tempest-VolumesActionsTest-1273129180 None] Acquiring lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd-detach_volume" by "detach_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:20 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9581e002-87a8-47c2-b85f-8fc156363388" returned: 0 in 0.305s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0b5d433e-6a09-4541-bdd4-56fc1992ba02 tempest-VolumesActionsTest-1273129180 None] Lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Lock "cinder-quobyte-9581e002-87a8-47c2-b85f-8fc156363388" released by "delete_volume" :: held 0.772s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0b5d433e-6a09-4541-bdd4-56fc1992ba02 tempest-VolumesActionsTest-1273129180 None] Detaching volume cbda363b-a1e7-4a4b-8fc7-6725ac88fecd from instance d625b8e8-1dfb-4636-b8bc-388fb2bb853a. Sep 01 02:14:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0b5d433e-6a09-4541-bdd4-56fc1992ba02 tempest-VolumesActionsTest-1273129180 None] Detach volume completed successfully. Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0b5d433e-6a09-4541-bdd4-56fc1992ba02 tempest-VolumesActionsTest-1273129180 None] Lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Created reservations ['32373dbf-2c55-43f3-b8af-f52776157bb9', '5bd87df0-bc6f-4674-9b1f-d47a5adc84c9', 'e99e7c68-de5e-4c3b-9a67-e549fac32f18', '7063de09-e216-4508-8619-5668f77551ce'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:20 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:14:20 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-06cd015c-239b-44fd-950c-3cf502187718 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd-detach_volume" by "detach_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-06cd015c-239b-44fd-950c-3cf502187718 tempest-VolumesActionsTest-1668895119 None] Lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-06cd015c-239b-44fd-950c-3cf502187718 tempest-VolumesActionsTest-1668895119 None] Volume detach called, but volume not attached. Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-06cd015c-239b-44fd-950c-3cf502187718 tempest-VolumesActionsTest-1668895119 None] Lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:20 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.403s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Deleted volume successfully. Sep 01 02:14:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fb6af437-262e-4fd2-b9b7-64f2ac9d10eb tempest-VolumesGetTest-2074814730 None] Lock "cinder-9581e002-87a8-47c2-b85f-8fc156363388-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "cinder-quobyte-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Lock "cinder-quobyte-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd" acquired by "delete_volume" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca90b33c-d8f7-4ca4-97f7-fc8496acd33b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:21 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd Sep 01 02:14:21 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c2bae0-3de2-49c4-b859-a130f3e3f753]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:21 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd" returned: 0 in 0.682s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:22 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd Sep 01 02:14:22 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf Sep 01 02:14:22 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd" returned: 0 in 0.369s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:22 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf" returned: 0 in 0.425s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Lock "cinder-quobyte-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd" released by "delete_volume" :: held 1.115s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe9e5ad-07e8-4d38-acb9-a57a23770364]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Created reservations ['5e8d9236-fddd-4328-9152-e2b6d3ae8c4d', '886b7322-9616-443f-af42-702c34bed3a8', 'f5845257-f15e-480e-b90c-a73b2f09b509', 'abcf8db3-adf1-45e6-b6c9-61714fbdb701'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:22 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf Sep 01 02:14:22 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:22 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:14:22 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf" returned: 0 in 0.499s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf /opt/stack/data/cinder/conversion/f6b36448-a708-4af4-82cc-61965e5d6daf.temp_image.ad5b30f2-dfe9-4d59-8487-73d1921f3afbzsjpg683.img {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:22 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf /opt/stack/data/cinder/conversion/f6b36448-a708-4af4-82cc-61965e5d6daf.temp_image.ad5b30f2-dfe9-4d59-8487-73d1921f3afbzsjpg683.img Sep 01 02:14:22 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:22 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.339s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:22 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:23 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Deleted volume successfully. Sep 01 02:14:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311b0181-9804-4fb3-84a6-35e39a5f78e7 tempest-VolumesActionsTest-1668895119 None] Lock "cinder-cbda363b-a1e7-4a4b-8fc7-6725ac88fecd-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:29 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf /opt/stack/data/cinder/conversion/f6b36448-a708-4af4-82cc-61965e5d6daf.temp_image.ad5b30f2-dfe9-4d59-8487-73d1921f3afbzsjpg683.img" returned: 0 in 6.285s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:29 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[21712228-e4a5-47f4-b86b-53d3042c51b1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:29 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf Sep 01 02:14:29 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:29 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf" returned: 0 in 0.617s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:29 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/conversion/f6b36448-a708-4af4-82cc-61965e5d6daf.temp_image.ad5b30f2-dfe9-4d59-8487-73d1921f3afbzsjpg683.img {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:14:29 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] Converted 1024.00 MB image at 162.90 MB/s Sep 01 02:14:29 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=84,cinder:UPDATE=105,cinder:INSERT=37,cinder:DELETE=12 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:29 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] ad5b30f2-dfe9-4d59-8487-73d1921f3afb was raw, no need to convert to raw {{(pid=87389) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (799034b6-5b53-4aac-b452-e31eb81187d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad1cf99-6168-45ec-8a21-ace1a6aca6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad1cf99-6168-45ec-8a21-ace1a6aca6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-978198174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:30Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2e9606-c725-4c4d-8a56-6a3d660c23fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2e9606-c725-4c4d-8a56-6a3d660c23fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d064c01-b03d-49c3-a751-6a7c5cfc43bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d064c01-b03d-49c3-a751-6a7c5cfc43bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d', 'volume_name': 'volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803d2f6f-e93e-4d37-b1aa-1de4fd3bfc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (803d2f6f-e93e-4d37-b1aa-1de4fd3bfc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838a75d4-79d2-47c6-b271-9fb532887199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:30 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Volume c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d', 'volume_size': 1} Sep 01 02:14:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:40 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=76,cinder:INSERT=23,cinder:DELETE=5,cinder:SELECT=59 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:40 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:14:43 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Flow 'volume_create_manager' (e10aeed2-2198-4731-937c-6fc552896bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79461a7-93dc-4d01-9ea9-6161c62db9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79461a7-93dc-4d01-9ea9-6161c62db9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-912689116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545fb7cf-3eca-45d6-bacb-233b465e1db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb3c5d2f47040cdb7bc2780edf67c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:44Z,use_quota=True,user_id='c6969d32d1834e099514cdc899db7160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01d60bf-8638-428a-bb0a-cac1bb12f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b01d60bf-8638-428a-bb0a-cac1bb12f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c51a4cd-73e7-4501-8c80-8111fa6f94fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c51a4cd-73e7-4501-8c80-8111fa6f94fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '545fb7cf-3eca-45d6-bacb-233b465e1db9', 'volume_name': 'volume-545fb7cf-3eca-45d6-bacb-233b465e1db9', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f202cb-f069-4fa0-85c7-303f356f8d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f202cb-f069-4fa0-85c7-303f356f8d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac5064f-45d6-468f-901c-f8eebfbe1178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:44 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Volume 545fb7cf-3eca-45d6-bacb-233b465e1db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-545fb7cf-3eca-45d6-bacb-233b465e1db9', 'volume_size': 1} Sep 01 02:14:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:47 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:14:47 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:47 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.241s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:14:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.404s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] Uploaded volume to glance image-id: ad5b30f2-dfe9-4d59-8487-73d1921f3afb. {{(pid=87389) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.663s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-978198174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:30Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Creating volume c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:51 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:51 devstack sudo[99681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d 1073741824 Sep 01 02:14:51 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e9f34500-21e7-4936-89d7-9b1695c5895e tempest-TestImageHashVerification-416462312 None] Copy volume to image completed successfully. Sep 01 02:14:51 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d 1073741824" returned: 0 in 0.489s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:51 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d Sep 01 02:14:51 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:52 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d" returned: 0 in 0.286s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.057s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-912689116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=545fb7cf-3eca-45d6-bacb-233b465e1db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb3c5d2f47040cdb7bc2780edf67c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:44Z,use_quota=True,user_id='c6969d32d1834e099514cdc899db7160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Creating volume 545fb7cf-3eca-45d6-bacb-233b465e1db9 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:52 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Acquiring lock "cinder-f6b36448-a708-4af4-82cc-61965e5d6daf-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:52 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 1073741824 Sep 01 02:14:52 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (838a75d4-79d2-47c6-b271-9fb532887199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7054c9e9-f2f3-40a9-bf91-d7ebdbb1f4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Lock "cinder-f6b36448-a708-4af4-82cc-61965e5d6daf-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:52 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Volume volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d (c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d): created successfully Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7054c9e9-f2f3-40a9-bf91-d7ebdbb1f4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (799034b6-5b53-4aac-b452-e31eb81187d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:52 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9a11b5d2-049e-40fc-8512-24fd217667aa tempest-VolumesActionsTest-1668895119 None] Created volume successfully. Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Acquiring lock "cinder-quobyte-f6b36448-a708-4af4-82cc-61965e5d6daf" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Lock "cinder-quobyte-f6b36448-a708-4af4-82cc-61965e5d6daf" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e175aca-0ebc-4004-a653-eef814eedc8c]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:52 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf Sep 01 02:14:52 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:52 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 1073741824" returned: 0 in 0.588s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:52 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf" returned: 0 in 0.448s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:52 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 Sep 01 02:14:52 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:52 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf Sep 01 02:14:52 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:53 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9" returned: 0 in 0.288s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:53 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f6b36448-a708-4af4-82cc-61965e5d6daf" returned: 0 in 0.283s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Lock "cinder-quobyte-f6b36448-a708-4af4-82cc-61965e5d6daf" released by "delete_volume" :: held 0.793s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac5064f-45d6-468f-901c-f8eebfbe1178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-545fb7cf-3eca-45d6-bacb-233b465e1db9', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa7e7e9-58a4-4722-8e29-1838959a6e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:53 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Volume volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 (545fb7cf-3eca-45d6-bacb-233b465e1db9): created successfully Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa7e7e9-58a4-4722-8e29-1838959a6e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Flow 'volume_create_manager' (e10aeed2-2198-4731-937c-6fc552896bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-53fb1b82-7c8f-4f61-bf00-4d3d7b27ab52 tempest-VolumesSnapshotTestJSON-1193825004 None] Created volume successfully. Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Created reservations ['8b2783df-e149-43d5-ac3d-5abb47e59a83', 'a4eb1811-8970-483f-960d-7e45eaecdd43', '4b39756c-0a5b-4782-9325-e1c6b9112901', '4f15a6bf-8a85-4be3-b7c0-7e6a3138ec9c'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:53 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:14:53 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Acquiring lock "cinder-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Lock "cinder-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Acquiring lock "cinder-quobyte-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Lock "cinder-quobyte-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eea663c-f3e0-4477-9254-a0491f874c18]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:53 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d Sep 01 02:14:53 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:53 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.383s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Deleted volume successfully. Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-aac303a4-706d-40f0-bd5c-864d0d8ade3e tempest-TestImageHashVerification-416462312 None] Lock "cinder-f6b36448-a708-4af4-82cc-61965e5d6daf-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:53 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d" returned: 0 in 0.421s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] Creating offline snapshot 566a6b7f-8438-4e88-9b63-dcc1903b8906 of volume 545fb7cf-3eca-45d6-bacb-233b465e1db9 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:14:53 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d Sep 01 02:14:53 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[10591eff-bb62-4029-b1af-82f16ac285ed]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:54 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 Sep 01 02:14:54 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:54 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d" returned: 0 in 0.274s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Lock "cinder-quobyte-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d" released by "delete_volume" :: held 0.751s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Created reservations ['b0d3d73d-04ff-4d14-b0a9-a4a4b952a016', 'bf50a948-5343-4a96-8b6c-8ebc5a95ed1f', '9f4744c1-ae26-407f-8698-d558ba24ef87', '53e81b23-eff4-4c00-8003-8a165e0cc910'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:54 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:14:54 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:54 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9" returned: 0 in 0.461s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:54 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 1G Sep 01 02:14:54 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:54 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.282s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:54 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Deleted volume successfully. Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3c62d6-9c6a-4ea7-b562-1e1547de2f6a tempest-VolumesActionsTest-1273129180 None] Lock "cinder-c1b76a5f-5ccf-4a5b-a9e9-b8f933a6a46d-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:54 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 1G" returned: 0 in 0.557s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:55 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 Sep 01 02:14:55 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (4ffd68f9-753e-4284-8527-debb11115097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830e41bb-bc69-4870-8719-c293e6e8b962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830e41bb-bc69-4870-8719-c293e6e8b962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-275899967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b56e28-6af8-44fa-9d89-6794c7450347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:55Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9178c2-fdc0-46b1-a7bc-c22cabeda162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e9178c2-fdc0-46b1-a7bc-c22cabeda162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe75deb-e0fb-499f-8c1c-caf4bfa87b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe75deb-e0fb-499f-8c1c-caf4bfa87b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b56e28-6af8-44fa-9d89-6794c7450347', 'volume_name': 'volume-65b56e28-6af8-44fa-9d89-6794c7450347', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8487f1e-22db-4716-a828-e893dad517e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8487f1e-22db-4716-a828-e893dad517e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:55 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cfe99b-fc32-4585-b3b5-b49c1c4a7cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:55 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Volume 65b56e28-6af8-44fa-9d89-6794c7450347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b56e28-6af8-44fa-9d89-6794c7450347', 'volume_size': 1} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906" returned: 0 in 0.398s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:55 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 is being set with open permissions: ugo+rw Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:55 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 Sep 01 02:14:55 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:55 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906" returned: 0 in 0.253s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:55 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.info Sep 01 02:14:55 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:55 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.info" returned: 0 in 0.266s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:55 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.info is being set with open permissions: ugo+rw Sep 01 02:14:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:55 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.info Sep 01 02:14:55 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:56 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.info" returned: 0 in 0.283s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.334s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.871s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-275899967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b56e28-6af8-44fa-9d89-6794c7450347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:55Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Creating volume 65b56e28-6af8-44fa-9d89-6794c7450347 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:56 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:56 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347 1073741824 Sep 01 02:14:56 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:56 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-477f6cba-fd01-4d57-a49f-c0bd3614d7ab tempest-VolumesSnapshotTestJSON-1193825004 None] Create snapshot completed successfully Sep 01 02:14:56 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347 1073741824" returned: 0 in 0.402s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:56 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347 Sep 01 02:14:56 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:56 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347" returned: 0 in 0.253s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60cfe99b-fc32-4585-b3b5-b49c1c4a7cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b56e28-6af8-44fa-9d89-6794c7450347', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e8ba51-65d1-40c6-abb5-c66e5ddb0bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:56 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Volume volume-65b56e28-6af8-44fa-9d89-6794c7450347 (65b56e28-6af8-44fa-9d89-6794c7450347): created successfully Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9e8ba51-65d1-40c6-abb5-c66e5ddb0bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (4ffd68f9-753e-4284-8527-debb11115097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:57 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-59a92e2c-76c9-4576-92c2-69f5488d8d56 tempest-VolumesActionsTest-1668895119 None] Created volume successfully. Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-566a6b7f-8438-4e88-9b63-dcc1903b8906-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-566a6b7f-8438-4e88-9b63-dcc1903b8906-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-545fb7cf-3eca-45d6-bacb-233b465e1db9" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-545fb7cf-3eca-45d6-bacb-233b465e1db9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-566a6b7f-8438-4e88-9b63-dcc1903b8906" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-566a6b7f-8438-4e88-9b63-dcc1903b8906" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Deleting offline snapshot 566a6b7f-8438-4e88-9b63-dcc1903b8906 of volume 545fb7cf-3eca-45d6-bacb-233b465e1db9 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] snapshot_file for this snap is: volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1fb7e7-7735-46ec-85f5-04f7f589aadb]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Acquiring lock "cinder-65b56e28-6af8-44fa-9d89-6794c7450347-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:57 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 Sep 01 02:14:57 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Lock "cinder-65b56e28-6af8-44fa-9d89-6794c7450347-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Acquiring lock "cinder-quobyte-65b56e28-6af8-44fa-9d89-6794c7450347" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Lock "cinder-quobyte-65b56e28-6af8-44fa-9d89-6794c7450347" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3297739f-f9ce-4191-8a21-f16f471e21a0]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:57 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347 Sep 01 02:14:57 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:57 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906" returned: 0 in 0.408s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-545fb7cf-3eca-45d6-bacb-233b465e1db9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce92db6-5bd5-4bb2-be6c-87af62d2c31a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:14:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:58 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 Sep 01 02:14:58 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:58 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347" returned: 0 in 0.458s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:58 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347 Sep 01 02:14:58 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:58 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9" returned: 0 in 0.446s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:58 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 Sep 01 02:14:58 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:58 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-65b56e28-6af8-44fa-9d89-6794c7450347" returned: 0 in 0.341s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Lock "cinder-quobyte-65b56e28-6af8-44fa-9d89-6794c7450347" released by "delete_volume" :: held 0.864s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Created reservations ['382eccf5-a92f-4ad9-950f-fd6c75874d28', 'e57c4318-8c47-48e8-9a68-891bfff6a5cd', '0f6e82a0-5f39-4ecf-9a58-f315652a6ecc', 'daaf4eac-641d-407b-ae19-a4ce4dfc5a8e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:58 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:14:58 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:58 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906" returned: 0 in 0.451s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:58 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906 Sep 01 02:14:58 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:14:58 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.285s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:58 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:14:58 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Deleted volume successfully. Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8db0ffae-677f-418f-bebd-fa4b3b545174 tempest-VolumesActionsTest-1273129180 None] Lock "cinder-65b56e28-6af8-44fa-9d89-6794c7450347-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:59 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9.566a6b7f-8438-4e88-9b63-dcc1903b8906" returned: 0 in 0.287s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-566a6b7f-8438-4e88-9b63-dcc1903b8906" released by "_delete_snapshot" :: held 1.745s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-545fb7cf-3eca-45d6-bacb-233b465e1db9" released by "delete_snapshot" :: held 1.774s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Created reservations ['88b34e6f-9306-45e6-8359-78f8d10b6638', 'eb41ff5d-b6e4-494d-99e1-0de70543384f', 'a260bb8d-88dc-4c25-8e4f-f32cc5bd0847', '7ebf199a-2a76-497d-828f-6b6cd8a5f144'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:14:59 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Delete snapshot completed successfully. Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dca17a8f-bcd2-4c0a-aa8a-e02e849f1d9f tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-566a6b7f-8438-4e88-9b63-dcc1903b8906-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (80c9804c-7f22-4494-8a7c-5a2d6e4e2700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80249f52-f545-4a0e-b862-6f4c5f40abad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80249f52-f545-4a0e-b862-6f4c5f40abad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1049933305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cffc8c8-3044-4cf5-84c9-4edaffc75940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:59Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100d682c-bc64-41f7-be34-88445f62f4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100d682c-bc64-41f7-be34-88445f62f4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797e08ef-ea1c-47ff-af9a-c099b4cb0bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (797e08ef-ea1c-47ff-af9a-c099b4cb0bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cffc8c8-3044-4cf5-84c9-4edaffc75940', 'volume_name': 'volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a5be81-f270-4743-a89f-da01e35dc079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22a5be81-f270-4743-a89f-da01e35dc079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2388889-e802-4fd6-952c-2fc4878b4896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:14:59 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Volume 6cffc8c8-3044-4cf5-84c9-4edaffc75940: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940', 'volume_size': 1} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1049933305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cffc8c8-3044-4cf5-84c9-4edaffc75940,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:14:59Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Creating volume 6cffc8c8-3044-4cf5-84c9-4edaffc75940 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:14:59 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:14:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:14:59 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940 1073741824 Sep 01 02:14:59 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:00 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Flow 'volume_create_manager' (2ed86551-6460-4ae7-9e17-9e9fc3e42812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728fb001-83a8-4fe5-916d-d09bc9e21cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940 1073741824" returned: 0 in 0.566s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728fb001-83a8-4fe5-916d-d09bc9e21cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1058988194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5bb394c-64f4-4491-9d2a-43723483958f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb3c5d2f47040cdb7bc2780edf67c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:00Z,use_quota=True,user_id='c6969d32d1834e099514cdc899db7160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202658ce-360c-46ee-ba2b-dfa5e9e1f853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202658ce-360c-46ee-ba2b-dfa5e9e1f853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1adb8580-1ef9-4e8b-b56f-158291c042c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1adb8580-1ef9-4e8b-b56f-158291c042c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5bb394c-64f4-4491-9d2a-43723483958f', 'volume_name': 'volume-a5bb394c-64f4-4491-9d2a-43723483958f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89291463-91ff-4580-af9a-7e8698c41e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89291463-91ff-4580-af9a-7e8698c41e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99729236-1c4d-4154-9ddb-802512f5c6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:00 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Volume a5bb394c-64f4-4491-9d2a-43723483958f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5bb394c-64f4-4491-9d2a-43723483958f', 'volume_size': 1} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:00 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940 Sep 01 02:15:00 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:00 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940" returned: 0 in 0.277s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.334s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1058988194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5bb394c-64f4-4491-9d2a-43723483958f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb3c5d2f47040cdb7bc2780edf67c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:00Z,use_quota=True,user_id='c6969d32d1834e099514cdc899db7160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Creating volume a5bb394c-64f4-4491-9d2a-43723483958f {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:00 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2388889-e802-4fd6-952c-2fc4878b4896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde48af4-6e06-45f6-bc5a-d6a124baa410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:00 devstack sudo[99802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f 1073741824 Sep 01 02:15:00 devstack sudo[99802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:00 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Volume volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940 (6cffc8c8-3044-4cf5-84c9-4edaffc75940): created successfully Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cde48af4-6e06-45f6-bc5a-d6a124baa410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (80c9804c-7f22-4494-8a7c-5a2d6e4e2700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-229437ab-24c9-4b89-82e9-5b8ec26d19e5 tempest-VolumesActionsTest-1668895119 None] Created volume successfully. Sep 01 02:15:00 devstack sudo[99802]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f 1073741824" returned: 0 in 0.451s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:01 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f Sep 01 02:15:01 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:01 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f" returned: 0 in 0.285s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99729236-1c4d-4154-9ddb-802512f5c6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5bb394c-64f4-4491-9d2a-43723483958f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aee2b41-aa92-4568-b559-9a6641760860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:01 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Volume volume-a5bb394c-64f4-4491-9d2a-43723483958f (a5bb394c-64f4-4491-9d2a-43723483958f): created successfully Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aee2b41-aa92-4568-b559-9a6641760860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Flow 'volume_create_manager' (2ed86551-6460-4ae7-9e17-9e9fc3e42812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:01 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9a84b3f6-84f5-4ed9-bacb-ff6b6ce3a156 tempest-VolumesSnapshotTestJSON-1193825004 None] Created volume successfully. Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Acquiring lock "cinder-6cffc8c8-3044-4cf5-84c9-4edaffc75940-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Lock "cinder-6cffc8c8-3044-4cf5-84c9-4edaffc75940-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Acquiring lock "cinder-quobyte-6cffc8c8-3044-4cf5-84c9-4edaffc75940" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Lock "cinder-quobyte-6cffc8c8-3044-4cf5-84c9-4edaffc75940" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa53114-9199-4004-9aca-82cc8b436883]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:01 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940 Sep 01 02:15:01 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:02 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940" returned: 0 in 0.365s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:02 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940 Sep 01 02:15:02 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] Creating offline snapshot 5adf961f-3998-4740-a6e9-4427c659a997 of volume a5bb394c-64f4-4491-9d2a-43723483958f {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:15:02 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cffc8c8-3044-4cf5-84c9-4edaffc75940" returned: 0 in 0.399s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ce08fe-e763-4882-a2b1-b255859ad173]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Lock "cinder-quobyte-6cffc8c8-3044-4cf5-84c9-4edaffc75940" released by "delete_volume" :: held 0.820s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Created reservations ['a1570aa2-db22-459d-bcd5-ddf3b55f09ce', '20d0e5cd-2495-4402-9da7-375163c8aacb', '4e8b4dfb-ff58-41df-8059-0c7cf3c51282', '41df6db0-6393-4ed4-9b07-f42755b70f67'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:02 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f Sep 01 02:15:02 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:02 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:02 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:02 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f" returned: 0 in 0.466s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:02 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.321s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:02 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:02 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 1G Sep 01 02:15:02 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:02 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Deleted volume successfully. Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d01ef53-4b20-423f-96db-6c83fa926a8f tempest-VolumesActionsTest-1273129180 None] Lock "cinder-6cffc8c8-3044-4cf5-84c9-4edaffc75940-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (3081eb78-8ee1-4e72-a216-a1a68ab8d9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028342dd-e1e9-4bee-b7a2-07c5abb847f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:03 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (028342dd-e1e9-4bee-b7a2-07c5abb847f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-205763768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c904cbf-6aff-4779-b9e3-977917d8de54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:03Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbb89b3-f540-41e8-a86c-8e760db9d684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbb89b3-f540-41e8-a86c-8e760db9d684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85115198-eba7-482d-a001-0330d7fb5caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85115198-eba7-482d-a001-0330d7fb5caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c904cbf-6aff-4779-b9e3-977917d8de54', 'volume_name': 'volume-3c904cbf-6aff-4779-b9e3-977917d8de54', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd40a41-3aed-4866-92d1-db89207c49bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abd40a41-3aed-4866-92d1-db89207c49bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4240a7e1-f702-48da-8472-9783f138890f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:03 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Volume 3c904cbf-6aff-4779-b9e3-977917d8de54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c904cbf-6aff-4779-b9e3-977917d8de54', 'volume_size': 1} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 1G" returned: 0 in 0.642s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5bb394c-64f4-4491-9d2a-43723483958f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:03 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5bb394c-64f4-4491-9d2a-43723483958f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 Sep 01 02:15:03 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:03 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5bb394c-64f4-4491-9d2a-43723483958f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997" returned: 0 in 0.303s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:03 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 is being set with open permissions: ugo+rw Sep 01 02:15:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:03 devstack sudo[99844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 Sep 01 02:15:03 devstack sudo[99844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:04 devstack sudo[99844]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997" returned: 0 in 0.255s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:04 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.info Sep 01 02:15:04 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:04 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.info" returned: 0 in 0.277s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:04 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.info is being set with open permissions: ugo+rw Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:04 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.info Sep 01 02:15:04 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:04 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.info" returned: 0 in 0.292s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.343s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.196s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-205763768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c904cbf-6aff-4779-b9e3-977917d8de54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:03Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Creating volume 3c904cbf-6aff-4779-b9e3-977917d8de54 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:04 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:15:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:04 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54 1073741824 Sep 01 02:15:04 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:04 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f6d928bc-6cd9-4067-8610-44d488e8539b tempest-VolumesSnapshotTestJSON-1193825004 None] Create snapshot completed successfully Sep 01 02:15:05 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54 1073741824" returned: 0 in 0.466s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:05 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54 Sep 01 02:15:05 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:05 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54" returned: 0 in 0.282s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4240a7e1-f702-48da-8472-9783f138890f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c904cbf-6aff-4779-b9e3-977917d8de54', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b407fb0-74d3-440c-b665-37ad5d002a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:05 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Volume volume-3c904cbf-6aff-4779-b9e3-977917d8de54 (3c904cbf-6aff-4779-b9e3-977917d8de54): created successfully Sep 01 02:15:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b407fb0-74d3-440c-b665-37ad5d002a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (3081eb78-8ee1-4e72-a216-a1a68ab8d9b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:05 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-23099032-6d23-48f8-bcb8-d27d3686981b tempest-VolumesActionsTest-1668895119 None] Created volume successfully. Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Flow 'volume_create_manager' (451d6fda-4474-4f43-8399-18223a102944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e74abb-b7d2-4b3f-8e97-f66698d2ba23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e74abb-b7d2-4b3f-8e97-f66698d2ba23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1715088582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=177fab6d-7ee0-4741-953d-8b472d818ef6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb3c5d2f47040cdb7bc2780edf67c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5adf961f-3998-4740-a6e9-4427c659a997,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:06Z,use_quota=True,user_id='c6969d32d1834e099514cdc899db7160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8865679-e0eb-44a0-a8b1-ffe283136a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8865679-e0eb-44a0-a8b1-ffe283136a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6b7ad6-b311-4186-864f-a36d55920bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6b7ad6-b311-4186-864f-a36d55920bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '177fab6d-7ee0-4741-953d-8b472d818ef6', 'volume_name': 'volume-177fab6d-7ee0-4741-953d-8b472d818ef6', 'volume_size': 2, 'snapshot_id': '5adf961f-3998-4740-a6e9-4427c659a997'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751e90dd-4153-4215-b26b-9a9cc10f86e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (751e90dd-4153-4215-b26b-9a9cc10f86e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a344d2b-2dcb-45b2-b6a5-3760b200678e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:06 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Volume 177fab6d-7ee0-4741-953d-8b472d818ef6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-177fab6d-7ee0-4741-953d-8b472d818ef6', 'volume_size': 2, 'snapshot_id': '5adf961f-3998-4740-a6e9-4427c659a997'} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-5adf961f-3998-4740-a6e9-4427c659a997-177fab6d-7ee0-4741-953d-8b472d818ef6" by "_create_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-5adf961f-3998-4740-a6e9-4427c659a997-177fab6d-7ee0-4741-953d-8b472d818ef6" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Creating volume 177fab6d-7ee0-4741-953d-8b472d818ef6 from snapshot 5adf961f-3998-4740-a6e9-4427c659a997 {{(pid=87389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-177fab6d-7ee0-4741-953d-8b472d818ef6" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-177fab6d-7ee0-4741-953d-8b472d818ef6" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] snapshot: 5adf961f-3998-4740-a6e9-4427c659a997, volume: 177fab6d-7ee0-4741-953d-8b472d818ef6, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[12599634-33da-44e5-b76a-d6d052778e03]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:06 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 Sep 01 02:15:06 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:06 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997" returned: 0 in 0.402s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5bb394c-64f4-4491-9d2a-43723483958f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[766aa3f3-e304-4700-b79f-622fba521ec0]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Acquiring lock "cinder-3c904cbf-6aff-4779-b9e3-977917d8de54-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Lock "cinder-3c904cbf-6aff-4779-b9e3-977917d8de54-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Acquiring lock "cinder-quobyte-3c904cbf-6aff-4779-b9e3-977917d8de54" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Lock "cinder-quobyte-3c904cbf-6aff-4779-b9e3-977917d8de54" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[db553279-0df4-48e3-af99-d0a50348dbf4]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:06 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f Sep 01 02:15:06 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:07 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54 Sep 01 02:15:07 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:07 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f" returned: 0 in 0.449s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6 not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:07 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6 Sep 01 02:15:07 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:07 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54" returned: 0 in 0.427s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:07 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54 Sep 01 02:15:07 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:07 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3c904cbf-6aff-4779-b9e3-977917d8de54" returned: 0 in 0.305s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Lock "cinder-quobyte-3c904cbf-6aff-4779-b9e3-977917d8de54" released by "delete_volume" :: held 0.788s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Created reservations ['54e3e093-e964-437f-a83c-e951b5cfde51', 'b2a3de55-1bd2-457b-aaa1-7c223ca504bc', 'fdfc53af-2c74-44a9-bfe5-7b7a6f619aa1', '9c3fca66-fda1-4695-9b69-16b5608c7863'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:07 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:07 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:08 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.978s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:08 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:08 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Deleted volume successfully. Sep 01 02:15:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23c148db-4da6-400c-bad7-1a9af31235fd tempest-VolumesActionsTest-1273129180 None] Lock "cinder-3c904cbf-6aff-4779-b9e3-977917d8de54-delete_volume" released by "delete_volume" :: held 2.097s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (8dab1254-8dbf-45a1-afc1-fb102705686b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fa8052-71b9-459d-9d9b-b3365e6df7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8fa8052-71b9-459d-9d9b-b3365e6df7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1891683199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34eb6b9-181c-4dac-a83d-4a345a725781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:09Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cff72d-e22d-43ac-a5b2-5ba7339d089e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02cff72d-e22d-43ac-a5b2-5ba7339d089e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e951bda6-6786-4430-96f7-f7d01faae0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e951bda6-6786-4430-96f7-f7d01faae0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a34eb6b9-181c-4dac-a83d-4a345a725781', 'volume_name': 'volume-a34eb6b9-181c-4dac-a83d-4a345a725781', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839f8216-b804-45d7-9028-3790824b4b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839f8216-b804-45d7-9028-3790824b4b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ba6342-c0b9-4df1-b7fd-ebd9600950e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:09 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Volume a34eb6b9-181c-4dac-a83d-4a345a725781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a34eb6b9-181c-4dac-a83d-4a345a725781', 'volume_size': 1} Sep 01 02:15:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:12 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6" returned: 0 in 5.288s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f, size 1024.00 MB, duration 5.29 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6 {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:15:12 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Converted 1024.00 MB image at 193.62 MB/s Sep 01 02:15:12 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6 is being set with open permissions: ugo+rw Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:12 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6 Sep 01 02:15:12 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:12 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6" returned: 0 in 0.277s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-177fab6d-7ee0-4741-953d-8b472d818ef6" released by "_copy_volume_from_snapshot" :: held 6.503s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-5adf961f-3998-4740-a6e9-4427c659a997-177fab6d-7ee0-4741-953d-8b472d818ef6" released by "_create_volume_from_snapshot" :: held 6.569s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.585s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.051s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1891683199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a34eb6b9-181c-4dac-a83d-4a345a725781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3dc9e0bba546e1a493fdded019fc8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:09Z,use_quota=True,user_id='cc96d5ff3c12467fbdfc2e4e5715fe06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Creating volume a34eb6b9-181c-4dac-a83d-4a345a725781 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:12 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:12 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781 1073741824 Sep 01 02:15:12 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a344d2b-2dcb-45b2-b6a5-3760b200678e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-177fab6d-7ee0-4741-953d-8b472d818ef6', 'volume_size': 2, 'snapshot_id': '5adf961f-3998-4740-a6e9-4427c659a997'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45705d57-f8e0-4b86-819e-f9c6d89a62f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:12 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Volume volume-177fab6d-7ee0-4741-953d-8b472d818ef6 (177fab6d-7ee0-4741-953d-8b472d818ef6): created successfully Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45705d57-f8e0-4b86-819e-f9c6d89a62f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Flow 'volume_create_manager' (451d6fda-4474-4f43-8399-18223a102944) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:12 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c45bbe78-5f40-4aa6-9cf6-76f5619ef1ed tempest-VolumesSnapshotTestJSON-1193825004 None] Created volume successfully. Sep 01 02:15:13 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781 1073741824" returned: 0 in 0.436s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:13 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781 Sep 01 02:15:13 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:13 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781" returned: 0 in 0.258s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30ba6342-c0b9-4df1-b7fd-ebd9600950e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a34eb6b9-181c-4dac-a83d-4a345a725781', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b790c82d-22e8-43ec-9ae9-941be6b5a3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:13 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Volume volume-a34eb6b9-181c-4dac-a83d-4a345a725781 (a34eb6b9-181c-4dac-a83d-4a345a725781): created successfully Sep 01 02:15:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b790c82d-22e8-43ec-9ae9-941be6b5a3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Flow 'volume_create_manager' (8dab1254-8dbf-45a1-afc1-fb102705686b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:13 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-eb5e646a-b0e8-4d7f-bc17-d3c0f8e934d9 tempest-VolumesActionsTest-1668895119 None] Created volume successfully. Sep 01 02:15:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-177fab6d-7ee0-4741-953d-8b472d818ef6-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-177fab6d-7ee0-4741-953d-8b472d818ef6-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-177fab6d-7ee0-4741-953d-8b472d818ef6" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-177fab6d-7ee0-4741-953d-8b472d818ef6" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:14 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66ad150-b274-4088-bfb3-f4ba7e5fbb90]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:14 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6 Sep 01 02:15:14 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:14 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6" returned: 0 in 0.390s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:14 devstack sudo[99919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6 Sep 01 02:15:14 devstack sudo[99919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:15 devstack sudo[99919]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-177fab6d-7ee0-4741-953d-8b472d818ef6" returned: 0 in 0.314s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-177fab6d-7ee0-4741-953d-8b472d818ef6" released by "delete_volume" :: held 0.768s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Created reservations ['9b0fb46c-d6ed-437d-a67d-40fb720a5b11', '7f631ae2-eff6-4431-af9c-94269ef2fe25', '9171e97e-7c53-43d3-a04d-af6d870dfcaa', 'b8fcca02-5cf5-4ac9-af99-251b130c1c77'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:15 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:15 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Acquiring lock "cinder-a34eb6b9-181c-4dac-a83d-4a345a725781-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-5adf961f-3998-4740-a6e9-4427c659a997-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Lock "cinder-a34eb6b9-181c-4dac-a83d-4a345a725781-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-5adf961f-3998-4740-a6e9-4427c659a997-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-a5bb394c-64f4-4491-9d2a-43723483958f" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-a5bb394c-64f4-4491-9d2a-43723483958f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-5adf961f-3998-4740-a6e9-4427c659a997" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Acquiring lock "cinder-quobyte-a34eb6b9-181c-4dac-a83d-4a345a725781" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-5adf961f-3998-4740-a6e9-4427c659a997" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Deleting offline snapshot 5adf961f-3998-4740-a6e9-4427c659a997 of volume a5bb394c-64f4-4491-9d2a-43723483958f {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:15:15 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] snapshot_file for this snap is: volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Lock "cinder-quobyte-a34eb6b9-181c-4dac-a83d-4a345a725781" acquired by "delete_volume" :: waited 0.049s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[133a6315-49ba-42ad-9134-7c66a907c517]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.464s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:15 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Deleted volume successfully. Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61056bd-7bd0-491a-8df4-4f2e1523701c]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7dd7f6e2-9342-4c8b-b6f6-767463b71046 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-177fab6d-7ee0-4741-953d-8b472d818ef6-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:15 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 Sep 01 02:15:15 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:15 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781 Sep 01 02:15:15 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:16 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997" returned: 0 in 0.477s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5bb394c-64f4-4491-9d2a-43723483958f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5fdc81-bc2b-40b0-ba72-e87183036e3d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:16 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781" returned: 0 in 0.547s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:16 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781 Sep 01 02:15:16 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:16 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f Sep 01 02:15:16 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:16 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a34eb6b9-181c-4dac-a83d-4a345a725781" returned: 0 in 0.364s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Lock "cinder-quobyte-a34eb6b9-181c-4dac-a83d-4a345a725781" released by "delete_volume" :: held 0.988s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Created reservations ['dcc2d1bb-b222-4ca2-9bfe-abd456114c1c', 'd7f3243f-d6fd-4687-a106-cfa1e28ae33c', '7b3d4aac-6c6d-4a5c-a4ed-c1a24695f253', '8bc565f3-0531-40b9-a066-e9cc73a76be9'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:16 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:16 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:17 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f" returned: 0 in 0.772s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:17 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 Sep 01 02:15:17 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:17 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.316s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:17 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:17 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Deleted volume successfully. Sep 01 02:15:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f02a77de-f676-4155-a922-6c269afbf8de tempest-VolumesActionsTest-1668895119 None] Lock "cinder-a34eb6b9-181c-4dac-a83d-4a345a725781-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:17 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997" returned: 0 in 0.445s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:17 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997 Sep 01 02:15:17 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:17 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f.5adf961f-3998-4740-a6e9-4427c659a997" returned: 0 in 0.287s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-5adf961f-3998-4740-a6e9-4427c659a997" released by "_delete_snapshot" :: held 2.122s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-a5bb394c-64f4-4491-9d2a-43723483958f" released by "delete_snapshot" :: held 2.179s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:17 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Created reservations ['3aa20598-f2de-4dd2-ae54-2594e553bb56', 'a8454d2b-4d41-471d-9ff3-eea4675d5a7a', '92a2a641-51ed-477a-814c-4ab6836d805e', '8aa550b4-048f-47d3-aae1-5b48079f6342'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:18 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Delete snapshot completed successfully. Sep 01 02:15:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cb1137-f312-4c98-92e1-bb828a0c1aed tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-5adf961f-3998-4740-a6e9-4427c659a997-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-a5bb394c-64f4-4491-9d2a-43723483958f-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-a5bb394c-64f4-4491-9d2a-43723483958f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-a5bb394c-64f4-4491-9d2a-43723483958f" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-a5bb394c-64f4-4491-9d2a-43723483958f" acquired by "delete_volume" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff33620-552b-4064-bdf9-1291775e9ddd]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:19 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f Sep 01 02:15:19 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:19 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f" returned: 0 in 0.408s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:19 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f Sep 01 02:15:19 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:19 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a5bb394c-64f4-4491-9d2a-43723483958f" returned: 0 in 0.325s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-a5bb394c-64f4-4491-9d2a-43723483958f" released by "delete_volume" :: held 0.830s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Created reservations ['de66f139-50cb-4612-ab33-9854706f24b3', '41ea9523-e004-41cb-9b01-9d75148aebeb', 'f30d4819-367a-4a9f-ac35-081752d80da1', 'd2c93f07-397e-449d-b614-9b76d4d6fcfa'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:20 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:20 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:20 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.463s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Deleted volume successfully. Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1830b573-edf1-4854-9c32-2073abceb242 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-a5bb394c-64f4-4491-9d2a-43723483958f-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Flow 'volume_create_manager' (86c1a4cc-b993-45ea-b67c-dc3c6329ada4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6400c092-7475-4c21-8b20-cac89df54e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6400c092-7475-4c21-8b20-cac89df54e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1737467180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996e4578-c2a0-4980-ad3d-c7a550ad05e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb3c5d2f47040cdb7bc2780edf67c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:21Z,use_quota=True,user_id='c6969d32d1834e099514cdc899db7160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32c6d99-ad81-48c8-bf5c-1fea5ce7829f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32c6d99-ad81-48c8-bf5c-1fea5ce7829f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66f2b7b-8eff-4abb-87be-8e55cac65e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c66f2b7b-8eff-4abb-87be-8e55cac65e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '996e4578-c2a0-4980-ad3d-c7a550ad05e6', 'volume_name': 'volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959c57d3-fd00-4319-80c8-81fae0e5de2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959c57d3-fd00-4319-80c8-81fae0e5de2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95c4fc9-f61e-4ad1-9e72-71217178e0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:20 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Volume 996e4578-c2a0-4980-ad3d-c7a550ad05e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6', 'volume_size': 1} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1737467180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=996e4578-c2a0-4980-ad3d-c7a550ad05e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb3c5d2f47040cdb7bc2780edf67c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:21Z,use_quota=True,user_id='c6969d32d1834e099514cdc899db7160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Creating volume 996e4578-c2a0-4980-ad3d-c7a550ad05e6 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:20 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:15:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:20 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 1073741824 Sep 01 02:15:20 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:21 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 1073741824" returned: 0 in 0.522s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:21 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 Sep 01 02:15:21 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:21 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6" returned: 0 in 0.261s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d95c4fc9-f61e-4ad1-9e72-71217178e0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a72aac-0e71-4ba3-b7c5-bf21851ab40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:21 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Volume volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 (996e4578-c2a0-4980-ad3d-c7a550ad05e6): created successfully Sep 01 02:15:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a72aac-0e71-4ba3-b7c5-bf21851ab40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Flow 'volume_create_manager' (86c1a4cc-b993-45ea-b67c-dc3c6329ada4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-34b39903-5f46-4ede-a0a2-c9f4d8dfb2f1 tempest-VolumesSnapshotTestJSON-1193825004 None] Created volume successfully. Sep 01 02:15:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:23 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] Creating offline snapshot 8aae30b2-ba9d-432c-8c9d-82998391b355 of volume 996e4578-c2a0-4980-ad3d-c7a550ad05e6 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:15:23 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[942fbf07-b60c-4aa9-9ea9-b1fc28cee408]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:23 devstack sudo[99984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 Sep 01 02:15:23 devstack sudo[99984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:23 devstack sudo[99984]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6" returned: 0 in 0.448s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:23 devstack sudo[99990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 1G Sep 01 02:15:23 devstack sudo[99990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:24 devstack sudo[99990]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 1G" returned: 0 in 0.526s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:24 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 Sep 01 02:15:24 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:24 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355" returned: 0 in 0.347s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:24 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 is being set with open permissions: ugo+rw Sep 01 02:15:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:24 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 Sep 01 02:15:24 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:24 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355" returned: 0 in 0.274s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:24 devstack sudo[100005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.info Sep 01 02:15:24 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:25 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.info" returned: 0 in 0.326s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:25 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.info is being set with open permissions: ugo+rw Sep 01 02:15:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:25 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.info Sep 01 02:15:25 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:25 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.info" returned: 0 in 0.294s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.374s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e3d04398-b4e7-4a78-b124-7cc7aa722dac tempest-VolumesSnapshotTestJSON-1193825004 None] Create snapshot completed successfully Sep 01 02:15:26 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Flow 'volume_create_manager' (573a00a0-17f3-4ccf-a5ff-e25fb2f17763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e971c5d-e47e-4b41-8b90-ccaa960f5d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e971c5d-e47e-4b41-8b90-ccaa960f5d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1541755172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=005ed5a1-5ccf-48eb-b278-b813b3d8a0ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fb3c5d2f47040cdb7bc2780edf67c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8aae30b2-ba9d-432c-8c9d-82998391b355,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:27Z,use_quota=True,user_id='c6969d32d1834e099514cdc899db7160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b4361a-a537-40da-b75a-ccae8113f3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b4361a-a537-40da-b75a-ccae8113f3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9dd44c-010c-467a-8576-3e838ccfa082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da9dd44c-010c-467a-8576-3e838ccfa082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '005ed5a1-5ccf-48eb-b278-b813b3d8a0ae', 'volume_name': 'volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae', 'volume_size': 1, 'snapshot_id': '8aae30b2-ba9d-432c-8c9d-82998391b355'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e1c93a-5c3f-4931-922d-edc0218d466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e1c93a-5c3f-4931-922d-edc0218d466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901627a8-7475-43b7-bd48-7c248aad1091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:26 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Volume 005ed5a1-5ccf-48eb-b278-b813b3d8a0ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae', 'volume_size': 1, 'snapshot_id': '8aae30b2-ba9d-432c-8c9d-82998391b355'} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-8aae30b2-ba9d-432c-8c9d-82998391b355-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" by "_create_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-8aae30b2-ba9d-432c-8c9d-82998391b355-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Creating volume 005ed5a1-5ccf-48eb-b278-b813b3d8a0ae from snapshot 8aae30b2-ba9d-432c-8c9d-82998391b355 {{(pid=87389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] snapshot: 8aae30b2-ba9d-432c-8c9d-82998391b355, volume: 005ed5a1-5ccf-48eb-b278-b813b3d8a0ae, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7252621-ac45-4242-8d6c-8feadf283c14]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:27 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 Sep 01 02:15:27 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:27 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355" returned: 0 in 0.505s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[136fe90b-43d4-423c-8ef4-c6a502862258]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:27 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 Sep 01 02:15:27 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:28 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6" returned: 0 in 0.408s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:15:28 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:15:28 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:15:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:28 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae Sep 01 02:15:28 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:34 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" returned: 0 in 5.942s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:34 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:15:34 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Converted 1024.00 MB image at 172.30 MB/s Sep 01 02:15:34 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae is being set with open permissions: ugo+rw Sep 01 02:15:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:34 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae Sep 01 02:15:34 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:34 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" returned: 0 in 0.315s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" released by "_copy_volume_from_snapshot" :: held 7.289s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-8aae30b2-ba9d-432c-8c9d-82998391b355-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" released by "_create_volume_from_snapshot" :: held 7.394s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.416s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (901627a8-7475-43b7-bd48-7c248aad1091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae', 'volume_size': 1, 'snapshot_id': '8aae30b2-ba9d-432c-8c9d-82998391b355'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f10ae3-f057-4f1e-aac9-46c90d1b3550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:34 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Volume volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae (005ed5a1-5ccf-48eb-b278-b813b3d8a0ae): created successfully Sep 01 02:15:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f10ae3-f057-4f1e-aac9-46c90d1b3550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Flow 'volume_create_manager' (573a00a0-17f3-4ccf-a5ff-e25fb2f17763) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:34 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2bf84d88-5098-43bc-a4d4-2d5c3404f2ea tempest-VolumesSnapshotTestJSON-1193825004 None] Created volume successfully. Sep 01 02:15:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" acquired by "delete_volume" :: waited 0.064s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:35 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a492bef8-6b8a-4a73-86fa-7a83ddc6f924]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:35 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae Sep 01 02:15:35 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:35 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" returned: 0 in 0.454s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:35 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae Sep 01 02:15:35 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:36 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" returned: 0 in 0.331s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae" released by "delete_volume" :: held 0.887s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Created reservations ['9e850e0c-5197-4807-8b2b-efddb7c0afbd', 'a751ae78-bd61-4c4d-bc85-cdcc0f79c4cb', 'd7bb3971-f94c-471b-8307-3aef2149bf95', '068372c1-ff37-44df-ab6a-c54f8cfa8e09'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:36 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:36 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:36 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.304s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:36 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Deleted volume successfully. Sep 01 02:15:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d12f3418-c80e-49fa-b965-2af7bdea6914 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-005ed5a1-5ccf-48eb-b278-b813b3d8a0ae-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-8aae30b2-ba9d-432c-8c9d-82998391b355-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-8aae30b2-ba9d-432c-8c9d-82998391b355-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-996e4578-c2a0-4980-ad3d-c7a550ad05e6" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-996e4578-c2a0-4980-ad3d-c7a550ad05e6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-8aae30b2-ba9d-432c-8c9d-82998391b355" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-8aae30b2-ba9d-432c-8c9d-82998391b355" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Deleting offline snapshot 8aae30b2-ba9d-432c-8c9d-82998391b355 of volume 996e4578-c2a0-4980-ad3d-c7a550ad05e6 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] snapshot_file for this snap is: volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8750d8e5-f1ac-4d81-a32c-48a93cb23196]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:37 devstack sudo[100088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 Sep 01 02:15:37 devstack sudo[100088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:37 devstack sudo[100088]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355" returned: 0 in 0.413s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[871a1898-c588-43e7-862e-6a854dacbac7]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:38 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 Sep 01 02:15:38 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Flow 'volume_create_manager' (888325c0-20df-475f-8e6a-54cda7d4b918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b09e6e4-b926-473c-9d49-ca3edbb99511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b09e6e4-b926-473c-9d49-ca3edbb99511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-598516381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77a5961-4b30-4d3a-a3fe-aaad7be20a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e1bf07d8d4dc4b5b9cb36f5b98463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:38Z,use_quota=True,user_id='5a5235755237421ca4ac52f8a4d3f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7b9336-133c-4ca2-8048-3067eb646513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca7b9336-133c-4ca2-8048-3067eb646513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2aa72a7-aa3d-495c-82c3-9ac2f11445ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2aa72a7-aa3d-495c-82c3-9ac2f11445ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77a5961-4b30-4d3a-a3fe-aaad7be20a7a', 'volume_name': 'volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a7ed95-ea06-45a4-9007-84e5adbb8703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30a7ed95-ea06-45a4-9007-84e5adbb8703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33435684-3770-46a8-869f-b95bd8cf4472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:38 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Volume e77a5961-4b30-4d3a-a3fe-aaad7be20a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a', 'volume_size': 1} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-598516381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77a5961-4b30-4d3a-a3fe-aaad7be20a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e1bf07d8d4dc4b5b9cb36f5b98463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:38Z,use_quota=True,user_id='5a5235755237421ca4ac52f8a4d3f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Creating volume e77a5961-4b30-4d3a-a3fe-aaad7be20a7a {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:38 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:38 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a 1073741824 Sep 01 02:15:38 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:38 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6" returned: 0 in 0.632s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:38 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 Sep 01 02:15:38 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:38 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355" returned: 0 in 0.390s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:39 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355 Sep 01 02:15:39 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:39 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a 1073741824" returned: 0 in 0.520s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:39 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a Sep 01 02:15:39 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Flow 'volume_create_manager' (99d86b4e-1cc5-4e94-9fba-e24519e22219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df78809-29bb-4522-ab28-73184d745404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df78809-29bb-4522-ab28-73184d745404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1005224404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bcc40d-bd96-4c18-85b1-2a1d192db892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bec9182ca3447cbd95372247b9ded7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:39Z,use_quota=True,user_id='8c41939b74334297b322edace919f110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4178b3-2ba8-41ff-a835-95c86aa48708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4178b3-2ba8-41ff-a835-95c86aa48708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2ff9ee-18a5-4ef0-9dd0-dd3686f623f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc2ff9ee-18a5-4ef0-9dd0-dd3686f623f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bcc40d-bd96-4c18-85b1-2a1d192db892', 'volume_name': 'volume-63bcc40d-bd96-4c18-85b1-2a1d192db892', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e874cd1-6e06-4749-9c5d-a4c67cfbc8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e874cd1-6e06-4749-9c5d-a4c67cfbc8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38aa24a-db9c-427b-bfb9-1363c3dfec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:39 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Volume 63bcc40d-bd96-4c18-85b1-2a1d192db892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bcc40d-bd96-4c18-85b1-2a1d192db892', 'volume_size': 1} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:39 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6.8aae30b2-ba9d-432c-8c9d-82998391b355" returned: 0 in 0.349s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-8aae30b2-ba9d-432c-8c9d-82998391b355" released by "_delete_snapshot" :: held 1.934s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-996e4578-c2a0-4980-ad3d-c7a550ad05e6" released by "delete_snapshot" :: held 1.965s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:39 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a" returned: 0 in 0.313s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.131s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1005224404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bcc40d-bd96-4c18-85b1-2a1d192db892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bec9182ca3447cbd95372247b9ded7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:39Z,use_quota=True,user_id='8c41939b74334297b322edace919f110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Creating volume 63bcc40d-bd96-4c18-85b1-2a1d192db892 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:39 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33435684-3770-46a8-869f-b95bd8cf4472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:39 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 1073741824 Sep 01 02:15:39 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca07998-3a2d-4db9-87d1-df5de63018bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:39 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Volume volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a (e77a5961-4b30-4d3a-a3fe-aaad7be20a7a): created successfully Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ca07998-3a2d-4db9-87d1-df5de63018bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Flow 'volume_create_manager' (888325c0-20df-475f-8e6a-54cda7d4b918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bc411598-6077-4473-b28e-2a83122cecd2 tempest-VolumesListAdminTestJSON-1250806795 None] Created volume successfully. Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Created reservations ['dd86f246-d9dc-43a3-883b-16fa51b028a9', '7ca97c46-651f-4138-8392-95b49689cbc3', '4b8d759d-e021-414b-8258-729505254aab', '22923d59-2d64-44e7-a5dc-72313f5b0284'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Delete snapshot completed successfully. Sep 01 02:15:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6626b822-f8d7-4e9d-aa74-28ae54844644 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-8aae30b2-ba9d-432c-8c9d-82998391b355-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:40 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 1073741824" returned: 0 in 0.572s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:40 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 Sep 01 02:15:40 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:40 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892" returned: 0 in 0.305s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f38aa24a-db9c-427b-bfb9-1363c3dfec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bcc40d-bd96-4c18-85b1-2a1d192db892', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36529a9-6e7d-4fc2-ba9f-ad839b5c5c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:40 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Volume volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 (63bcc40d-bd96-4c18-85b1-2a1d192db892): created successfully Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36529a9-6e7d-4fc2-ba9f-ad839b5c5c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Flow 'volume_create_manager' (99d86b4e-1cc5-4e94-9fba-e24519e22219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:40 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9131f306-cc16-4d90-92c3-52efa0527828 tempest-TestStampPattern-138466576 None] Created volume successfully. Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-996e4578-c2a0-4980-ad3d-c7a550ad05e6-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-996e4578-c2a0-4980-ad3d-c7a550ad05e6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=133,cinder:SELECT=107,cinder:INSERT=27,cinder:DELETE=15 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=104,cinder:INSERT=36,cinder:UPDATE=128,cinder:DELETE=9 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-996e4578-c2a0-4980-ad3d-c7a550ad05e6" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-996e4578-c2a0-4980-ad3d-c7a550ad05e6" acquired by "delete_volume" :: waited 0.031s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ced7e23-972b-4364-bcb8-6214512416bc]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:41 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 Sep 01 02:15:41 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Flow 'volume_create_manager' (069dfdec-38f8-48fe-96b9-35e1437ecdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f95a9c3-dedd-491b-a20a-eee5d125ac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f95a9c3-dedd-491b-a20a-eee5d125ac44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1388861206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c103572d-a636-4f4b-9537-d6a6c4fdf3f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e1bf07d8d4dc4b5b9cb36f5b98463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:41Z,use_quota=True,user_id='5a5235755237421ca4ac52f8a4d3f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9069f21f-7f9a-4c58-8d01-b7c4e1b4ffd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9069f21f-7f9a-4c58-8d01-b7c4e1b4ffd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a160c4ee-889a-48ad-9726-9727cbdcc016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a160c4ee-889a-48ad-9726-9727cbdcc016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c103572d-a636-4f4b-9537-d6a6c4fdf3f5', 'volume_name': 'volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0809e75-01de-47bf-abe8-40c0cda6e0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0809e75-01de-47bf-abe8-40c0cda6e0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206916d8-be66-441f-a02f-ba3d10dcd28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:41 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Volume c103572d-a636-4f4b-9537-d6a6c4fdf3f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5', 'volume_size': 1} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1388861206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c103572d-a636-4f4b-9537-d6a6c4fdf3f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e1bf07d8d4dc4b5b9cb36f5b98463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:41Z,use_quota=True,user_id='5a5235755237421ca4ac52f8a4d3f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Creating volume c103572d-a636-4f4b-9537-d6a6c4fdf3f5 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:41 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:41 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5 1073741824 Sep 01 02:15:41 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:41 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6" returned: 0 in 0.511s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:41 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6 Sep 01 02:15:41 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:41 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-996e4578-c2a0-4980-ad3d-c7a550ad05e6" returned: 0 in 0.360s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-996e4578-c2a0-4980-ad3d-c7a550ad05e6" released by "delete_volume" :: held 0.955s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:41 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5 1073741824" returned: 0 in 0.559s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:41 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Created reservations ['157f737f-4fd0-4cf7-8b29-a71129d014a1', '303832ff-dc03-4031-b1a0-4f98700d14e9', '5a510aa9-a985-418c-ad2f-555eaf9d9d55', '66b929d1-2990-4966-9812-79c9db7c7210'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:41 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5 Sep 01 02:15:41 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:42 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:42 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:42 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5" returned: 0 in 0.321s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206916d8-be66-441f-a02f-ba3d10dcd28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ac5d92-4502-45c6-bc71-8abfb999e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:42 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Volume volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5 (c103572d-a636-4f4b-9537-d6a6c4fdf3f5): created successfully Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ac5d92-4502-45c6-bc71-8abfb999e471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Flow 'volume_create_manager' (069dfdec-38f8-48fe-96b9-35e1437ecdcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:42 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9694aa41-0b2a-4e83-96b9-a57fdc8387f8 tempest-VolumesListAdminTestJSON-1250806795 None] Created volume successfully. Sep 01 02:15:42 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.353s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:42 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Deleted volume successfully. Sep 01 02:15:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7e4532d2-ef1f-4d91-91ac-07bef3906071 tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-996e4578-c2a0-4980-ad3d-c7a550ad05e6-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-545fb7cf-3eca-45d6-bacb-233b465e1db9-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-545fb7cf-3eca-45d6-bacb-233b465e1db9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "cinder-quobyte-545fb7cf-3eca-45d6-bacb-233b465e1db9" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-545fb7cf-3eca-45d6-bacb-233b465e1db9" acquired by "delete_volume" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:43 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ab79a3-634d-4654-bec0-7fb9b051831f]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:43 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 Sep 01 02:15:43 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:43 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9" returned: 0 in 0.434s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:43 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9 Sep 01 02:15:43 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Flow 'volume_create_manager' (fbca8b8e-4389-45a7-9fb1-a6f7ba54b2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cde5959-5c8c-42c1-8f5e-1fc760c78482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cde5959-5c8c-42c1-8f5e-1fc760c78482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-803709526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30b1428-e89f-487e-86a1-e20fd20a5b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e1bf07d8d4dc4b5b9cb36f5b98463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:44Z,use_quota=True,user_id='5a5235755237421ca4ac52f8a4d3f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a975c907-6230-4cc9-b6ea-a7d68bdb857e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a975c907-6230-4cc9-b6ea-a7d68bdb857e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:44 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a09462-7941-4287-a1b0-fe591d13051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a09462-7941-4287-a1b0-fe591d13051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c30b1428-e89f-487e-86a1-e20fd20a5b01', 'volume_name': 'volume-c30b1428-e89f-487e-86a1-e20fd20a5b01', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c1731c-e0d3-4d71-a27b-e0d4c8c2d568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46c1731c-e0d3-4d71-a27b-e0d4c8c2d568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad79002-37cb-4773-acda-bdb36b73e2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:44 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Volume c30b1428-e89f-487e-86a1-e20fd20a5b01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c30b1428-e89f-487e-86a1-e20fd20a5b01', 'volume_size': 1} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-803709526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30b1428-e89f-487e-86a1-e20fd20a5b01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='661e1bf07d8d4dc4b5b9cb36f5b98463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:44Z,use_quota=True,user_id='5a5235755237421ca4ac52f8a4d3f535',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Creating volume c30b1428-e89f-487e-86a1-e20fd20a5b01 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:44 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-545fb7cf-3eca-45d6-bacb-233b465e1db9" returned: 0 in 0.449s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:44 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01 1073741824 Sep 01 02:15:44 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-quobyte-545fb7cf-3eca-45d6-bacb-233b465e1db9" released by "delete_volume" :: held 0.985s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Created reservations ['ec5cebfd-0e07-43a1-8d23-6d73dd2c1b23', '11411943-4311-4816-a591-78f49b63e9d8', 'eb654d07-70d2-4c4f-b401-a4ab3c208e28', '5a055b25-f3dc-4908-a953-622ded047dd2'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:44 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:44 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:44 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.372s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:44 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Deleted volume successfully. Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a52079a-fca3-4218-b304-a9d68a59163b tempest-VolumesSnapshotTestJSON-1193825004 None] Lock "cinder-545fb7cf-3eca-45d6-bacb-233b465e1db9-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:44 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01 1073741824" returned: 0 in 0.773s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:45 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01 Sep 01 02:15:45 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:45 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01" returned: 0 in 0.482s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fad79002-37cb-4773-acda-bdb36b73e2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c30b1428-e89f-487e-86a1-e20fd20a5b01', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331f8b85-1dd5-4414-a575-72646d20d49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:45 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Volume volume-c30b1428-e89f-487e-86a1-e20fd20a5b01 (c30b1428-e89f-487e-86a1-e20fd20a5b01): created successfully Sep 01 02:15:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (331f8b85-1dd5-4414-a575-72646d20d49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Flow 'volume_create_manager' (fbca8b8e-4389-45a7-9fb1-a6f7ba54b2f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:45 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-dbfb9d56-2280-459d-891a-4f87b1a9cfc6 tempest-VolumesListAdminTestJSON-1250806795 None] Created volume successfully. Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Flow 'volume_create_manager' (112ad6c7-67ed-4146-a448-afb15db2a2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c245c446-5e6d-4fe9-8811-9abd9140efba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c245c446-5e6d-4fe9-8811-9abd9140efba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88dc84ca-8bd1-4042-ba4d-e504860d1fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756bd28954b3473d81a7cc17e2c37eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:47Z,use_quota=True,user_id='6811a77b2038408aa2fe90b2805fb693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70f4301-e1f6-4a42-a80f-9a11d802502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70f4301-e1f6-4a42-a80f-9a11d802502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd8ec60-2291-4905-92bc-a7155a1ca3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd8ec60-2291-4905-92bc-a7155a1ca3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88dc84ca-8bd1-4042-ba4d-e504860d1fef', 'volume_name': 'volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905ebfe0-6cfa-41fb-971b-d575bf8b9414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905ebfe0-6cfa-41fb-971b-d575bf8b9414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd86db7-15f4-42be-89a1-6a381898ea51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:47 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Volume 88dc84ca-8bd1-4042-ba4d-e504860d1fef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef', 'volume_size': 1} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:15:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88dc84ca-8bd1-4042-ba4d-e504860d1fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='756bd28954b3473d81a7cc17e2c37eeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:15:47Z,use_quota=True,user_id='6811a77b2038408aa2fe90b2805fb693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Creating volume 88dc84ca-8bd1-4042-ba4d-e504860d1fef {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:15:47 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:47 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef 1073741824 Sep 01 02:15:47 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:47 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:47 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:47 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.494s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:15:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:15:48 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef 1073741824" returned: 0 in 0.929s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:48 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef Sep 01 02:15:48 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:48 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef" returned: 0 in 0.432s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:15:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd86db7-15f4-42be-89a1-6a381898ea51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02f1e80-1661-44a6-a543-8c65e345f54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:15:48 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Volume volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef (88dc84ca-8bd1-4042-ba4d-e504860d1fef): created successfully Sep 01 02:15:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02f1e80-1661-44a6-a543-8c65e345f54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:15:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Flow 'volume_create_manager' (112ad6c7-67ed-4146-a448-afb15db2a2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:15:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-724e416c-b970-453b-9ff9-e97b7c8b5a79 tempest-VolumesListAdminTestJSON-1835746553 None] Created volume successfully. Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Acquiring lock "cinder-88dc84ca-8bd1-4042-ba4d-e504860d1fef-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Lock "cinder-88dc84ca-8bd1-4042-ba4d-e504860d1fef-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Acquiring lock "cinder-quobyte-88dc84ca-8bd1-4042-ba4d-e504860d1fef" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Lock "cinder-quobyte-88dc84ca-8bd1-4042-ba4d-e504860d1fef" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "cinder-c30b1428-e89f-487e-86a1-e20fd20a5b01-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d3b039-d78a-499e-8261-f0633ee1760b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-c30b1428-e89f-487e-86a1-e20fd20a5b01-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "cinder-quobyte-c30b1428-e89f-487e-86a1-e20fd20a5b01" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-quobyte-c30b1428-e89f-487e-86a1-e20fd20a5b01" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:49 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef Sep 01 02:15:49 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fa70eb-90cc-4193-ae0f-35c00dd51ae8]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:49 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01 Sep 01 02:15:49 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:50 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef" returned: 0 in 0.512s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:50 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef Sep 01 02:15:50 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:50 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01" returned: 0 in 0.556s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:50 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01 Sep 01 02:15:50 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:50 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-88dc84ca-8bd1-4042-ba4d-e504860d1fef" returned: 0 in 0.505s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Lock "cinder-quobyte-88dc84ca-8bd1-4042-ba4d-e504860d1fef" released by "delete_volume" :: held 1.101s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Created reservations ['ab16704b-fd55-42d0-a6df-089732c377b6', 'c92bef7b-d02f-411a-b65d-67a3f40f54b7', '133d783d-b6b0-456b-a470-519229aaba1e', '5da344a4-5c91-421c-8eac-93d65b371811'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:50 devstack sudo[100284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:50 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:50 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c30b1428-e89f-487e-86a1-e20fd20a5b01" returned: 0 in 0.573s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-quobyte-c30b1428-e89f-487e-86a1-e20fd20a5b01" released by "delete_volume" :: held 1.186s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Created reservations ['d592bde3-14af-4996-8f49-5e210b74a67d', '89be8383-8867-4575-80a0-2768b8e86917', 'f77b01fb-7209-444d-a69b-e28cccd956de', '6f2f6d34-baba-4412-9fb4-4906a0aee7ab'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:51 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:51 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:51 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.509s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Deleted volume successfully. Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-452e10a4-b6d1-4261-8063-8e2128302257 tempest-VolumesListAdminTestJSON-1835746553 None] Lock "cinder-88dc84ca-8bd1-4042-ba4d-e504860d1fef-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:51 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.494s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Deleted volume successfully. Sep 01 02:15:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4a96a69d-c654-496a-8399-749fb1b74f67 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-c30b1428-e89f-487e-86a1-e20fd20a5b01-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "cinder-c103572d-a636-4f4b-9537-d6a6c4fdf3f5-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-c103572d-a636-4f4b-9537-d6a6c4fdf3f5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "cinder-quobyte-c103572d-a636-4f4b-9537-d6a6c4fdf3f5" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-quobyte-c103572d-a636-4f4b-9537-d6a6c4fdf3f5" acquired by "delete_volume" :: waited 0.036s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:52 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41b675f-6b42-4998-bdad-15ed0cd52aba]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:52 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5 Sep 01 02:15:52 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:52 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5" returned: 0 in 0.483s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:52 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5 Sep 01 02:15:52 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:53 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c103572d-a636-4f4b-9537-d6a6c4fdf3f5" returned: 0 in 0.441s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-quobyte-c103572d-a636-4f4b-9537-d6a6c4fdf3f5" released by "delete_volume" :: held 1.031s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Created reservations ['50c85756-c79e-45ca-a164-ee92cf6153be', '7209bbb7-db73-445f-baf6-8b5f383b873d', 'cbfd7483-1e10-4635-bf4e-4fde97b1a851', '0967d1a9-6b7c-47f0-9386-8e96794e5d1e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:53 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:53 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:53 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.328s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Deleted volume successfully. Sep 01 02:15:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-913127c6-9fee-4a3e-9f8a-a137089452aa tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-c103572d-a636-4f4b-9537-d6a6c4fdf3f5-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "cinder-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "cinder-quobyte-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:15:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-quobyte-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a" acquired by "delete_volume" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:15:54 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54f92b4-4748-4cd4-8424-d6c039ef2d52]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:15:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:54 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a Sep 01 02:15:54 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:55 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a" returned: 0 in 0.472s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:55 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a Sep 01 02:15:55 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:55 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a" returned: 0 in 0.323s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-quobyte-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a" released by "delete_volume" :: held 0.848s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:15:55 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Created reservations ['2235dbc6-bef6-42fb-ba0f-e37f617ebebb', '86e7e8d0-6de1-4eaf-859e-74470de4a374', 'b21a28e3-c5e2-4c1b-a7f8-5580d5c069ee', '3f70c228-9959-415e-9a86-6bd445352325'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:15:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:15:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:15:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:15:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:15:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:15:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:15:55 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:15:55 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:15:56 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 01 02:15:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.376s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:15:56 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:15:56 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Deleted volume successfully. Sep 01 02:15:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-672bac90-c10d-478a-9ce0-e0480d906ef3 tempest-VolumesListAdminTestJSON-1250806795 None] Lock "cinder-e77a5961-4b30-4d3a-a3fe-aaad7be20a7a-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Flow 'volume_create_manager' (52666f89-b426-41e6-a25c-7884799f2587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c833bee6-c677-4a53-923d-fefb08323674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c833bee6-c677-4a53-923d-fefb08323674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-658215611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2f403e-289c-40fe-853c-51e8f6fdd448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e9744fbffa4de1a4bc94ae76abb745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:05Z,use_quota=True,user_id='6780bf1fee194ae8a8748463c7bc3b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db15197a-cad6-49f7-8c12-b86a311dd343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db15197a-cad6-49f7-8c12-b86a311dd343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae82869a-fa61-4313-b812-c04f6209b528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.image.glance [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Creating Keystone auth plugin from conf {{(pid=87389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae82869a-fa61-4313-b812-c04f6209b528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4b2f403e-289c-40fe-853c-51e8f6fdd448', 'volume_name': 'volume-4b2f403e-289c-40fe-853c-51e8f6fdd448', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7646e7ec-3fce-4e90-b434-68ad8ef631ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7646e7ec-3fce-4e90-b434-68ad8ef631ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0921e11-ad93-4a1a-8e51-88560b31dd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:05 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Volume 4b2f403e-289c-40fe-853c-51e8f6fdd448: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4b2f403e-289c-40fe-853c-51e8f6fdd448', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 01 02:16:05 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Trying to clone 4b2f403e-289c-40fe-853c-51e8f6fdd448 from image 97f1460d-e99d-469e-a933-615f59c7b55c at location (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]). {{(pid=87389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:16:06 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:16:06 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Image download 20.69 MB at 20.69 MB/s Sep 01 02:16:06 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af59a2f-19fe-4d44-b931-855f43485a4b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:06 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD Sep 01 02:16:06 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:06 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:06 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Temporary image 97f1460d-e99d-469e-a933-615f59c7b55c is fetched for user 6780bf1fee194ae8a8748463c7bc3b99. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:16:06 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3fa283-a24e-4538-8afd-eb8c7325b31b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:07 devstack sudo[100364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD Sep 01 02:16:07 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:07 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-658215611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b2f403e-289c-40fe-853c-51e8f6fdd448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33e9744fbffa4de1a4bc94ae76abb745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:05Z,use_quota=True,user_id='6780bf1fee194ae8a8748463c7bc3b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Creating volume 4b2f403e-289c-40fe-853c-51e8f6fdd448 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:07 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:07 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 1073741824 Sep 01 02:16:07 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:07 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 1073741824" returned: 0 in 0.538s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:07 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 Sep 01 02:16:07 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:08 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448" returned: 0 in 0.277s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:08 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Attempting download of 97f1460d-e99d-469e-a933-615f59c7b55c ((None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}])) to volume 4b2f403e-289c-40fe-853c-51e8f6fdd448. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:16:08 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f26334-6406-42de-a25b-540003d41734]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_a9_h3ch3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:08 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_a9_h3ch3 Sep 01 02:16:08 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:08 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_a9_h3ch3" returned: 0 in 0.358s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_a9_h3ch3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:08 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_a9_h3ch3 Sep 01 02:16:08 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:09 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_a9_h3ch3" returned: 1 in 0.364s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97f1460d-e99d-469e-a933-615f59c7b55c_a9_h3ch3' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:16:09 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6756e4fd-6556-4a83-aad6-f7f2a7eca3eb]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:09 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD Sep 01 02:16:09 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:09 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:09 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] 97f1460d-e99d-469e-a933-615f59c7b55c was qcow2, converting to qcow2 {{(pid=87389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:16:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:09 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 Sep 01 02:16:09 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:11 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448" returned: 0 in 1.894s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:11 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97f1460d-e99d-469e-a933-615f59c7b55c_xkznsgzvdevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:16:11 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Converted 112.00 MB image at 59.10 MB/s Sep 01 02:16:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:11 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 1G Sep 01 02:16:11 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:11 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 1G" returned: 0 in 0.487s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:11 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Downloaded image 97f1460d-e99d-469e-a933-615f59c7b55c ((None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}])) to volume 4b2f403e-289c-40fe-853c-51e8f6fdd448 successfully. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:16:11 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Temporary image 97f1460d-e99d-469e-a933-615f59c7b55c for user 6780bf1fee194ae8a8748463c7bc3b99 is deleted. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:16:11 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Marking volume 4b2f403e-289c-40fe-853c-51e8f6fdd448 as bootable. {{(pid=87389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:16:11 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Copying metadata from image 97f1460d-e99d-469e-a933-615f59c7b55c to 4b2f403e-289c-40fe-853c-51e8f6fdd448. {{(pid=87389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:16:11 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Creating volume glance metadata for volume 4b2f403e-289c-40fe-853c-51e8f6fdd448 backed by image 97f1460d-e99d-469e-a933-615f59c7b55c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:16:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0921e11-ad93-4a1a-8e51-88560b31dd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b2f403e-289c-40fe-853c-51e8f6fdd448', 'volume_size': 1, 'image_id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97f1460d-e99d-469e-a933-615f59c7b55c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8e5115013cfc46e7b25a06bae52922c6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '97f1460d-e99d-469e-a933-615f59c7b55c', 'created_at': datetime.datetime(2026, 8, 31, 23, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 31, 23, 56, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97f1460d-e99d-469e-a933-615f59c7b55c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a3a1cd-7567-4d77-bc08-b5300b32d30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:12 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Volume volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 (4b2f403e-289c-40fe-853c-51e8f6fdd448): created successfully Sep 01 02:16:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a3a1cd-7567-4d77-bc08-b5300b32d30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Flow 'volume_create_manager' (52666f89-b426-41e6-a25c-7884799f2587) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:12 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0b0c02de-4b3a-47cb-a24c-2322489fb7dd tempest-VolumesImageMetadata-1791926485 None] Created volume successfully. Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Acquiring lock "cinder-4b2f403e-289c-40fe-853c-51e8f6fdd448-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Lock "cinder-4b2f403e-289c-40fe-853c-51e8f6fdd448-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Acquiring lock "cinder-quobyte-4b2f403e-289c-40fe-853c-51e8f6fdd448" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Lock "cinder-quobyte-4b2f403e-289c-40fe-853c-51e8f6fdd448" acquired by "delete_volume" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f0238a-48d9-414d-a742-a3b2b98a5ef1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-0641a911-c462-4f26-971c-9c6aef7ab213 req-5a270572-1651-46d5-af3c-3ddd1e41349f tempest-TestStampPattern-138466576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-0641a911-c462-4f26-971c-9c6aef7ab213 req-5a270572-1651-46d5-af3c-3ddd1e41349f tempest-TestStampPattern-138466576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-0641a911-c462-4f26-971c-9c6aef7ab213 req-5a270572-1651-46d5-af3c-3ddd1e41349f tempest-TestStampPattern-138466576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-0641a911-c462-4f26-971c-9c6aef7ab213 req-5a270572-1651-46d5-af3c-3ddd1e41349f tempest-TestStampPattern-138466576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-63bcc40d-bd96-4c18-85b1-2a1d192db892', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41d80ec8-b3c1-4d29-bf3f-e2303a4b9456', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:16:13 devstack sudo[100422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 Sep 01 02:16:13 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-0641a911-c462-4f26-971c-9c6aef7ab213 req-5a270572-1651-46d5-af3c-3ddd1e41349f tempest-TestStampPattern-138466576 None] attachment_update completed successfully. Sep 01 02:16:13 devstack sudo[100422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:13 devstack sudo[100422]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448" returned: 0 in 0.514s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:13 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448 Sep 01 02:16:13 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:14 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4b2f403e-289c-40fe-853c-51e8f6fdd448" returned: 0 in 0.340s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Lock "cinder-quobyte-4b2f403e-289c-40fe-853c-51e8f6fdd448" released by "delete_volume" :: held 0.926s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Created reservations ['5b9495f0-7f77-491f-ad27-a5cc869789cb', '60979d3c-0370-4e03-9a12-23491cc62b4b', '9a13e157-e335-4d65-b8ab-30490cf2ed99', 'ad1598bb-17a1-4479-8fdd-a3214295053d'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:14 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:16:14 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:14 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.323s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Deleted volume successfully. Sep 01 02:16:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cb546160-d9e0-414a-ad04-808b026aa132 tempest-VolumesImageMetadata-1791926485 None] Lock "cinder-4b2f403e-289c-40fe-853c-51e8f6fdd448-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-71d5874e-f796-4547-8413-04fa765e7edb req-836d0827-2fec-4bf7-9185-2ead40e3b74a tempest-TestStampPattern-138466576 None] Terminate volume connection completed successfully. Sep 01 02:16:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-71d5874e-f796-4547-8413-04fa765e7edb req-836d0827-2fec-4bf7-9185-2ead40e3b74a tempest-TestStampPattern-138466576 None] Deleting attachment 41d80ec8-b3c1-4d29-bf3f-e2303a4b9456. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Flow 'volume_create_manager' (22bb0d89-2318-4b6c-a4f4-1f58a6aec49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50192f51-3850-4727-8ef9-3c047c4ef104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50192f51-3850-4727-8ef9-3c047c4ef104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1592724712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1d0075-eafe-4fde-81a8-c8f518acb124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb4e2ad3545a4d9ea207d298ade3f7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:20Z,use_quota=True,user_id='2dcf6506a44548db912d2fa79fd61ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a55a2f-9973-4585-8ab5-e6eb49a1d6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a55a2f-9973-4585-8ab5-e6eb49a1d6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bb5a76-79e4-4ebd-b4fa-1a5e8feceaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bb5a76-79e4-4ebd-b4fa-1a5e8feceaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1d0075-eafe-4fde-81a8-c8f518acb124', 'volume_name': 'volume-2a1d0075-eafe-4fde-81a8-c8f518acb124', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e464090-e950-4643-a64d-d2e3f4e49218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e464090-e950-4643-a64d-d2e3f4e49218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aead4315-29e4-449f-ad81-4adcdfec69fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:20 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Volume 2a1d0075-eafe-4fde-81a8-c8f518acb124: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1d0075-eafe-4fde-81a8-c8f518acb124', 'volume_size': 1} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1592724712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1d0075-eafe-4fde-81a8-c8f518acb124,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb4e2ad3545a4d9ea207d298ade3f7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:20Z,use_quota=True,user_id='2dcf6506a44548db912d2fa79fd61ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Creating volume 2a1d0075-eafe-4fde-81a8-c8f518acb124 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:20 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:20 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 1073741824 Sep 01 02:16:20 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:20 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 1073741824" returned: 0 in 0.509s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:20 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 Sep 01 02:16:20 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:21 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124" returned: 0 in 0.274s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.617s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aead4315-29e4-449f-ad81-4adcdfec69fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1d0075-eafe-4fde-81a8-c8f518acb124', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581ca1a3-7140-444f-aa1d-6fecbd1a6854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] Creating offline snapshot 1dbdc2b5-0bce-4d60-8f6e-77267a51096d of volume 63bcc40d-bd96-4c18-85b1-2a1d192db892 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:16:21 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Volume volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 (2a1d0075-eafe-4fde-81a8-c8f518acb124): created successfully Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581ca1a3-7140-444f-aa1d-6fecbd1a6854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Flow 'volume_create_manager' (22bb0d89-2318-4b6c-a4f4-1f58a6aec49f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[230f7130-20d3-4a3c-9c79-6f8ff8e341bd]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3c0f225b-1738-46d1-8c9c-43753061a042 tempest-VolumesDeleteCascade-406997109 None] Created volume successfully. Sep 01 02:16:21 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 Sep 01 02:16:21 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:21 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892" returned: 0 in 0.405s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:21 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d 1G Sep 01 02:16:21 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:22 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d 1G" returned: 0 in 0.449s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:22 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d Sep 01 02:16:22 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:22 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d" returned: 0 in 0.362s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:22 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d is being set with open permissions: ugo+rw Sep 01 02:16:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:22 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d Sep 01 02:16:22 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:22 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d" returned: 0 in 0.356s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:22 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.info Sep 01 02:16:22 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:23 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.info" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:23 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.info is being set with open permissions: ugo+rw Sep 01 02:16:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:23 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.info Sep 01 02:16:23 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:23 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.info" returned: 0 in 0.306s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.281s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.888s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:23 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] Creating offline snapshot 5f2ad36b-edef-4d35-bf9c-f591956bc994 of volume 2a1d0075-eafe-4fde-81a8-c8f518acb124 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:16:23 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-00b65aa9-2c11-4793-845d-39ba3650cb7a tempest-TestStampPattern-138466576 None] Create snapshot completed successfully Sep 01 02:16:23 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a78f03-7265-4890-b33a-d6e488a4bf7a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:23 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 Sep 01 02:16:23 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:23 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124" returned: 0 in 0.477s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:23 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 1G Sep 01 02:16:23 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:24 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 1G" returned: 0 in 0.690s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:24 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 Sep 01 02:16:24 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:25 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994" returned: 0 in 0.409s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:25 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 is being set with open permissions: ugo+rw Sep 01 02:16:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:25 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 Sep 01 02:16:25 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:25 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994" returned: 0 in 0.325s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:25 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.info Sep 01 02:16:25 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:25 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.info" returned: 0 in 0.328s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:25 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.info is being set with open permissions: ugo+rw Sep 01 02:16:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:25 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.info Sep 01 02:16:25 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:26 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.info" returned: 0 in 0.307s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:26 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6a53e624-ae66-4a44-b5f0-27d0ce9e5407 tempest-VolumesDeleteCascade-406997109 None] Create snapshot completed successfully Sep 01 02:16:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] Creating offline snapshot 1d39398b-853e-4723-9ead-59e93a1aa952 of volume 2a1d0075-eafe-4fde-81a8-c8f518acb124 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:16:27 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[51220068-0469-4f4b-bcfc-ecdf6c0742c5]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:27 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 Sep 01 02:16:27 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:27 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994" returned: 0 in 0.514s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a1d0075-eafe-4fde-81a8-c8f518acb124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:27 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 1G Sep 01 02:16:27 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:28 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 1G" returned: 0 in 0.903s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:28 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 Sep 01 02:16:28 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952" returned: 0 in 0.709s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:29 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 is being set with open permissions: ugo+rw Sep 01 02:16:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:29 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:29 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 Sep 01 02:16:29 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:29 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952" returned: 0 in 0.500s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.798s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:29 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b20d49d0-9899-4b24-9b5a-ca47f421089b tempest-VolumesDeleteCascade-406997109 None] Create snapshot completed successfully Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-2a1d0075-eafe-4fde-81a8-c8f518acb124-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-2a1d0075-eafe-4fde-81a8-c8f518acb124-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Performing cascade delete. {{(pid=87389) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-1d39398b-853e-4723-9ead-59e93a1aa952-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-1d39398b-853e-4723-9ead-59e93a1aa952-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-quobyte-2a1d0075-eafe-4fde-81a8-c8f518acb124" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-2a1d0075-eafe-4fde-81a8-c8f518acb124" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-quobyte-1d39398b-853e-4723-9ead-59e93a1aa952" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-1d39398b-853e-4723-9ead-59e93a1aa952" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Deleting offline snapshot 1d39398b-853e-4723-9ead-59e93a1aa952 of volume 2a1d0075-eafe-4fde-81a8-c8f518acb124 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] snapshot_file for this snap is: volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6542e06-b408-4729-8388-0a2a8ee8b921]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:30 devstack sudo[101103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 Sep 01 02:16:30 devstack sudo[101103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:31 devstack sudo[101103]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952" returned: 0 in 0.446s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a1d0075-eafe-4fde-81a8-c8f518acb124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:31 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4edb7a-331e-417b-8ac4-f89246addc83]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:31 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 Sep 01 02:16:31 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:31 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994" returned: 0 in 0.615s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a1d0075-eafe-4fde-81a8-c8f518acb124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:31 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 Sep 01 02:16:31 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:32 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952" returned: 0 in 0.506s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:32 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952 Sep 01 02:16:32 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:32 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.1d39398b-853e-4723-9ead-59e93a1aa952" returned: 0 in 0.295s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-1d39398b-853e-4723-9ead-59e93a1aa952" released by "_delete_snapshot" :: held 2.004s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-2a1d0075-eafe-4fde-81a8-c8f518acb124" released by "delete_snapshot" :: held 2.040s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:32 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Created reservations ['ae84ac65-a2b6-4a36-9f26-c65804dc5972', '83b39b48-be15-4e34-9d76-9fcac9ada430', 'b9f7306b-9dbd-4524-8e82-7d814e44572a', '93110e3e-d3a5-4de9-a504-0579b3bc94ae'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:32 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Delete snapshot completed successfully. Sep 01 02:16:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-1d39398b-853e-4723-9ead-59e93a1aa952-delete_snapshot" released by "delete_snapshot" :: held 2.363s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-5f2ad36b-edef-4d35-bf9c-f591956bc994-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-5f2ad36b-edef-4d35-bf9c-f591956bc994-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-quobyte-2a1d0075-eafe-4fde-81a8-c8f518acb124" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-2a1d0075-eafe-4fde-81a8-c8f518acb124" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-quobyte-5f2ad36b-edef-4d35-bf9c-f591956bc994" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-5f2ad36b-edef-4d35-bf9c-f591956bc994" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Deleting offline snapshot 5f2ad36b-edef-4d35-bf9c-f591956bc994 of volume 2a1d0075-eafe-4fde-81a8-c8f518acb124 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] snapshot_file for this snap is: volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f6be53-1cf3-4c27-8276-2062b90e147e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:33 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 Sep 01 02:16:33 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Flow 'volume_create_manager' (e82deeca-f36f-4148-ab1b-a9ae7a181b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa305d72-b7e3-413a-9468-36d0b407c31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa305d72-b7e3-413a-9468-36d0b407c31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-625356816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=538224d7-8fe1-4fb3-b93f-9bbfbb018624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5bec9182ca3447cbd95372247b9ded7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1dbdc2b5-0bce-4d60-8f6e-77267a51096d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:34Z,use_quota=True,user_id='8c41939b74334297b322edace919f110',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5972fe-325a-4904-9ac7-210fe7fcff6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba5972fe-325a-4904-9ac7-210fe7fcff6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d279db3-6da5-440b-adfd-c5a4f610aa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d279db3-6da5-440b-adfd-c5a4f610aa99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '538224d7-8fe1-4fb3-b93f-9bbfbb018624', 'volume_name': 'volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624', 'volume_size': 1, 'snapshot_id': '1dbdc2b5-0bce-4d60-8f6e-77267a51096d'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cced30a-f09c-4429-885d-99fcf8d673f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cced30a-f09c-4429-885d-99fcf8d673f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37791f79-ee86-4db7-a8f5-3da2a0f55371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:33 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Volume 538224d7-8fe1-4fb3-b93f-9bbfbb018624: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624', 'volume_size': 1, 'snapshot_id': '1dbdc2b5-0bce-4d60-8f6e-77267a51096d'} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Acquiring lock "cinder-quobyte-1dbdc2b5-0bce-4d60-8f6e-77267a51096d-538224d7-8fe1-4fb3-b93f-9bbfbb018624" by "_create_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-1dbdc2b5-0bce-4d60-8f6e-77267a51096d-538224d7-8fe1-4fb3-b93f-9bbfbb018624" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Creating volume 538224d7-8fe1-4fb3-b93f-9bbfbb018624 from snapshot 1dbdc2b5-0bce-4d60-8f6e-77267a51096d {{(pid=87389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Acquiring lock "cinder-quobyte-538224d7-8fe1-4fb3-b93f-9bbfbb018624" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-538224d7-8fe1-4fb3-b93f-9bbfbb018624" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] snapshot: 1dbdc2b5-0bce-4d60-8f6e-77267a51096d, volume: 538224d7-8fe1-4fb3-b93f-9bbfbb018624, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2314d0a-9cf8-418e-b755-1f97506be2dd]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:33 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994" returned: 0 in 0.793s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a1d0075-eafe-4fde-81a8-c8f518acb124(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:34 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[600ac92b-5f29-4680-be61-7f7a095bdd29]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:34 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d Sep 01 02:16:34 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:34 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 Sep 01 02:16:34 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:34 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d" returned: 0 in 0.609s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63bcc40d-bd96-4c18-85b1-2a1d192db892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:34 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb80ce8a-9be3-4e10-839c-3a5cf2227ce2]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:34 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124" returned: 0 in 0.706s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:34 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 Sep 01 02:16:34 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:34 devstack sudo[101142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 Sep 01 02:16:34 devstack sudo[101142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:35 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892" returned: 0 in 0.636s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:16:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:16:35 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:16:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:35 devstack sudo[101155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 Sep 01 02:16:35 devstack sudo[101155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:35 devstack sudo[101142]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994" returned: 0 in 0.671s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:35 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994 Sep 01 02:16:35 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:35 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124.5f2ad36b-edef-4d35-bf9c-f591956bc994" returned: 0 in 0.360s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-5f2ad36b-edef-4d35-bf9c-f591956bc994" released by "_delete_snapshot" :: held 2.725s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-2a1d0075-eafe-4fde-81a8-c8f518acb124" released by "delete_snapshot" :: held 2.767s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:35 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Created reservations ['d3466863-e680-44c6-b92e-32ed89852e69', '68c68b22-19b2-4848-b9fd-8af6233444c6', 'b0180900-7fec-43c4-abf0-fc42308fc450', 'd6291fa2-87a9-4208-a35f-708622551500'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:36 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Delete snapshot completed successfully. Sep 01 02:16:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-5f2ad36b-edef-4d35-bf9c-f591956bc994-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Snapshots deleted, issuing volume delete {{(pid=87389) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 02:16:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-quobyte-2a1d0075-eafe-4fde-81a8-c8f518acb124" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-2a1d0075-eafe-4fde-81a8-c8f518acb124" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:36 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac23166-a3f2-43fd-9492-af19f22e5581]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:36 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 Sep 01 02:16:36 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:38 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124" returned: 0 in 1.873s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:38 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124 Sep 01 02:16:38 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:39 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-2a1d0075-eafe-4fde-81a8-c8f518acb124" returned: 0 in 1.208s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-2a1d0075-eafe-4fde-81a8-c8f518acb124" released by "delete_volume" :: held 3.268s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:39 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Created reservations ['eacd221a-3dfb-42fb-9e6e-b594531d4c9f', '34319f21-2a2f-4e5f-80ef-3a213d3a95e9', '10903bdd-e580-4d26-a082-471c5504b1c0', 'e5bbe8be-8f17-4866-8b72-599e516d5e58'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:16:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:40 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:16:40 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:41 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.975s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:41 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Deleted volume successfully. Sep 01 02:16:41 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=86,cinder:UPDATE=100,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fd2d0329-1016-458a-90a7-ac24bcc6bd59 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-2a1d0075-eafe-4fde-81a8-c8f518acb124-delete_volume" released by "delete_volume" :: held 10.813s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=94,cinder:SELECT=88,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Flow 'volume_create_manager' (c2fcd0e4-a2af-4a16-98c6-a86c210dcbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f924a4-eea5-47f8-8edb-53507295b597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3f924a4-eea5-47f8-8edb-53507295b597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1395568014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8c3aed-9f9a-415d-813d-1cf36571292b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb4e2ad3545a4d9ea207d298ade3f7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:43Z,use_quota=True,user_id='2dcf6506a44548db912d2fa79fd61ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ccab88-b9c1-4146-ba04-3b8409f56b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ccab88-b9c1-4146-ba04-3b8409f56b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9215b0-c0cc-4e55-a565-4d7be0fe42f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf9215b0-c0cc-4e55-a565-4d7be0fe42f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8c3aed-9f9a-415d-813d-1cf36571292b', 'volume_name': 'volume-0f8c3aed-9f9a-415d-813d-1cf36571292b', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552f3e5a-1b17-4175-8eb8-17c0c8e9c454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552f3e5a-1b17-4175-8eb8-17c0c8e9c454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb46aca-bde8-4aa4-b226-2a298a4c669d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:43 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Volume 0f8c3aed-9f9a-415d-813d-1cf36571292b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8c3aed-9f9a-415d-813d-1cf36571292b', 'volume_size': 1} Sep 01 02:16:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:44 devstack sudo[101155]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624" returned: 0 in 8.929s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892, size 1024.00 MB, duration 8.93 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:16:44 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Converted 1024.00 MB image at 114.64 MB/s Sep 01 02:16:44 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 is being set with open permissions: ugo+rw Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:44 devstack sudo[101202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 Sep 01 02:16:44 devstack sudo[101202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:44 devstack sudo[101202]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624" returned: 0 in 0.339s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-538224d7-8fe1-4fb3-b93f-9bbfbb018624" released by "_copy_volume_from_snapshot" :: held 10.678s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-1dbdc2b5-0bce-4d60-8f6e-77267a51096d-538224d7-8fe1-4fb3-b93f-9bbfbb018624" released by "_create_volume_from_snapshot" :: held 10.781s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.806s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.047s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1395568014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8c3aed-9f9a-415d-813d-1cf36571292b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb4e2ad3545a4d9ea207d298ade3f7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:43Z,use_quota=True,user_id='2dcf6506a44548db912d2fa79fd61ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Creating volume 0f8c3aed-9f9a-415d-813d-1cf36571292b {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:44 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:44 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b 1073741824 Sep 01 02:16:44 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37791f79-ee86-4db7-a8f5-3da2a0f55371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624', 'volume_size': 1, 'snapshot_id': '1dbdc2b5-0bce-4d60-8f6e-77267a51096d'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3131a886-35a3-4e41-b9b6-546efd790de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:44 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Volume volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 (538224d7-8fe1-4fb3-b93f-9bbfbb018624): created successfully Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3131a886-35a3-4e41-b9b6-546efd790de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Flow 'volume_create_manager' (e82deeca-f36f-4148-ab1b-a9ae7a181b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:44 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5f369b13-9374-46f8-8deb-395037fa92e7 tempest-TestStampPattern-138466576 None] Created volume successfully. Sep 01 02:16:45 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b 1073741824" returned: 0 in 0.575s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:45 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b Sep 01 02:16:45 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:45 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b" returned: 0 in 0.273s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fb46aca-bde8-4aa4-b226-2a298a4c669d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8c3aed-9f9a-415d-813d-1cf36571292b', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a212bee7-5f77-48e0-a624-ed0d8f08eb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:45 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Volume volume-0f8c3aed-9f9a-415d-813d-1cf36571292b (0f8c3aed-9f9a-415d-813d-1cf36571292b): created successfully Sep 01 02:16:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a212bee7-5f77-48e0-a624-ed0d8f08eb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Flow 'volume_create_manager' (c2fcd0e4-a2af-4a16-98c6-a86c210dcbf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:45 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9eb15463-fa28-4c1c-a410-902d91285b5d tempest-VolumesDeleteCascade-406997109 None] Created volume successfully. Sep 01 02:16:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] Creating offline snapshot 72bb7a60-ae02-429c-906f-1024e1995553 of volume 0f8c3aed-9f9a-415d-813d-1cf36571292b {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:16:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f5e5ad-4eb3-4a88-a00d-1ad75ceb33d9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:46 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b Sep 01 02:16:46 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:47 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b" returned: 0 in 0.460s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:47 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 1G Sep 01 02:16:47 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:47 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:16:47 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:47 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 1G" returned: 0 in 0.647s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8c3aed-9f9a-415d-813d-1cf36571292b -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:47 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8c3aed-9f9a-415d-813d-1cf36571292b -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 Sep 01 02:16:47 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:47 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.475s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:16:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:16:48 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8c3aed-9f9a-415d-813d-1cf36571292b -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553" returned: 0 in 0.362s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:48 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 is being set with open permissions: ugo+rw Sep 01 02:16:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:48 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 Sep 01 02:16:48 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:48 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553" returned: 0 in 0.298s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:48 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.info Sep 01 02:16:48 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:48 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.info" returned: 0 in 0.423s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:48 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.info is being set with open permissions: ugo+rw Sep 01 02:16:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:48 devstack sudo[101304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.info Sep 01 02:16:48 devstack sudo[101304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:49 devstack sudo[101304]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.info" returned: 0 in 0.401s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.726s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:49 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7ddc7058-29e1-472f-9e2e-b069d61bcee5 tempest-VolumesDeleteCascade-406997109 None] Create snapshot completed successfully Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Flow 'volume_create_manager' (ca175036-a379-4447-860c-e19dc6fbd688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345c8415-ab6d-4ad4-a4e5-b479d333447e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (345c8415-ab6d-4ad4-a4e5-b479d333447e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-103312853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34e2f3e-5c63-46d6-9a7d-8097088728f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb4e2ad3545a4d9ea207d298ade3f7dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=72bb7a60-ae02-429c-906f-1024e1995553,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:50Z,use_quota=True,user_id='2dcf6506a44548db912d2fa79fd61ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d078cc2b-9a2e-4e6a-a45f-5170c149eac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d078cc2b-9a2e-4e6a-a45f-5170c149eac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd193b8-83bc-4c84-838b-3b3be82e1070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccd193b8-83bc-4c84-838b-3b3be82e1070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f34e2f3e-5c63-46d6-9a7d-8097088728f8', 'volume_name': 'volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8', 'volume_size': 1, 'snapshot_id': '72bb7a60-ae02-429c-906f-1024e1995553'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7574d28e-bcf6-4cca-8477-36727c71cd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7574d28e-bcf6-4cca-8477-36727c71cd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7b91b1-ecc7-4cfa-b033-91fa7a84683f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:50 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Volume f34e2f3e-5c63-46d6-9a7d-8097088728f8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8', 'volume_size': 1, 'snapshot_id': '72bb7a60-ae02-429c-906f-1024e1995553'} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-quobyte-72bb7a60-ae02-429c-906f-1024e1995553-f34e2f3e-5c63-46d6-9a7d-8097088728f8" by "_create_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-72bb7a60-ae02-429c-906f-1024e1995553-f34e2f3e-5c63-46d6-9a7d-8097088728f8" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Creating volume f34e2f3e-5c63-46d6-9a7d-8097088728f8 from snapshot 72bb7a60-ae02-429c-906f-1024e1995553 {{(pid=87389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-quobyte-f34e2f3e-5c63-46d6-9a7d-8097088728f8" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-f34e2f3e-5c63-46d6-9a7d-8097088728f8" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] snapshot: 72bb7a60-ae02-429c-906f-1024e1995553, volume: f34e2f3e-5c63-46d6-9a7d-8097088728f8, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf9d58f-7395-4b62-8ab4-1f75a9a8a8c7]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:50 devstack sudo[101307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 Sep 01 02:16:50 devstack sudo[101307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:51 devstack sudo[101307]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553" returned: 0 in 0.460s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8c3aed-9f9a-415d-813d-1cf36571292b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:16:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7503f34d-e68a-4e24-9ff9-6709cebc1131]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:16:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:51 devstack sudo[101313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b Sep 01 02:16:51 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:51 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b" returned: 0 in 0.502s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:16:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:16:51 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:16:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:51 devstack sudo[101319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 Sep 01 02:16:51 devstack sudo[101319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:57 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:16:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Flow 'volume_create_manager' (0364e421-5939-4297-8820-06fab5101dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beac3817-27e5-4f68-a275-929f298e9e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beac3817-27e5-4f68-a275-929f298e9e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-720997344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38e2792-6626-43ab-a44a-6f33345fb832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd4c0f259c64d3989bfda8e22ec6352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:58Z,use_quota=True,user_id='95b907b20fea409f8435a45b49579772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326f2440-b710-43fd-afb4-4f4154588bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326f2440-b710-43fd-afb4-4f4154588bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8179e3-31a9-41b5-8a16-652c43f7189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8179e3-31a9-41b5-8a16-652c43f7189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a38e2792-6626-43ab-a44a-6f33345fb832', 'volume_name': 'volume-a38e2792-6626-43ab-a44a-6f33345fb832', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f058a9-abb3-4bd9-bdbe-4e2c45e468f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51f058a9-abb3-4bd9-bdbe-4e2c45e468f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd071c2e-5847-427b-955e-4c13119b7b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:58 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Volume a38e2792-6626-43ab-a44a-6f33345fb832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a38e2792-6626-43ab-a44a-6f33345fb832', 'volume_size': 1} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:58 devstack sudo[101319]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8" returned: 0 in 6.926s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:16:58 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Converted 1024.00 MB image at 147.83 MB/s Sep 01 02:16:58 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 is being set with open permissions: ugo+rw Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:58 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 Sep 01 02:16:58 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:58 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8" returned: 0 in 0.285s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-f34e2f3e-5c63-46d6-9a7d-8097088728f8" released by "_copy_volume_from_snapshot" :: held 8.281s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-72bb7a60-ae02-429c-906f-1024e1995553-f34e2f3e-5c63-46d6-9a7d-8097088728f8" released by "_create_volume_from_snapshot" :: held 8.362s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.387s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.723s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-720997344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38e2792-6626-43ab-a44a-6f33345fb832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cd4c0f259c64d3989bfda8e22ec6352',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:16:58Z,use_quota=True,user_id='95b907b20fea409f8435a45b49579772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Creating volume a38e2792-6626-43ab-a44a-6f33345fb832 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:16:58 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:16:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:59 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832 1073741824 Sep 01 02:16:59 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a7b91b1-ecc7-4cfa-b033-91fa7a84683f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8', 'volume_size': 1, 'snapshot_id': '72bb7a60-ae02-429c-906f-1024e1995553'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8ce2c5-9c4c-4d7f-9e82-0c98414dd22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:59 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Volume volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 (f34e2f3e-5c63-46d6-9a7d-8097088728f8): created successfully Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8ce2c5-9c4c-4d7f-9e82-0c98414dd22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Flow 'volume_create_manager' (ca175036-a379-4447-860c-e19dc6fbd688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:59 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0a8b3f2f-d8e5-4556-a865-9b3f0e1c2ea3 tempest-VolumesDeleteCascade-406997109 None] Created volume successfully. Sep 01 02:16:59 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832 1073741824" returned: 0 in 0.460s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:16:59 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832 Sep 01 02:16:59 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:16:59 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832" returned: 0 in 0.266s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd071c2e-5847-427b-955e-4c13119b7b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38e2792-6626-43ab-a44a-6f33345fb832', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c028b0-d811-4ff9-a57b-41addf3b2083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:16:59 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Volume volume-a38e2792-6626-43ab-a44a-6f33345fb832 (a38e2792-6626-43ab-a44a-6f33345fb832): created successfully Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24c028b0-d811-4ff9-a57b-41addf3b2083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Flow 'volume_create_manager' (0364e421-5939-4297-8820-06fab5101dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:16:59 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ff3b40fc-b1a9-4cc1-b60d-08d0de331495 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Created volume successfully. Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-0f8c3aed-9f9a-415d-813d-1cf36571292b-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-0f8c3aed-9f9a-415d-813d-1cf36571292b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Performing cascade delete. {{(pid=87389) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 01 02:16:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-72bb7a60-ae02-429c-906f-1024e1995553-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-72bb7a60-ae02-429c-906f-1024e1995553-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-quobyte-0f8c3aed-9f9a-415d-813d-1cf36571292b" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-0f8c3aed-9f9a-415d-813d-1cf36571292b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-quobyte-72bb7a60-ae02-429c-906f-1024e1995553" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-72bb7a60-ae02-429c-906f-1024e1995553" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Deleting offline snapshot 72bb7a60-ae02-429c-906f-1024e1995553 of volume 0f8c3aed-9f9a-415d-813d-1cf36571292b {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] snapshot_file for this snap is: volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9629c9b7-b1ce-4f22-9162-0ddb2d232949]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:00 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 Sep 01 02:17:00 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:00 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553" returned: 0 in 0.382s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8c3aed-9f9a-415d-813d-1cf36571292b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab6889a-d12f-41b0-8f86-a191bcefd72f]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:00 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b Sep 01 02:17:00 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:01 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b" returned: 0 in 0.689s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:01 devstack sudo[101391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 Sep 01 02:17:01 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:01 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553" returned: 0 in 0.421s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:01 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553 Sep 01 02:17:01 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-cf906440-34fc-4e3d-9311-048b5deddda7 req-f14389f0-ee83-4f0c-a544-6d8b40d29c81 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-cf906440-34fc-4e3d-9311-048b5deddda7 req-f14389f0-ee83-4f0c-a544-6d8b40d29c81 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-cf906440-34fc-4e3d-9311-048b5deddda7 req-f14389f0-ee83-4f0c-a544-6d8b40d29c81 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-cf906440-34fc-4e3d-9311-048b5deddda7 req-f14389f0-ee83-4f0c-a544-6d8b40d29c81 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-a38e2792-6626-43ab-a44a-6f33345fb832', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3276a7d9-6355-4f57-a296-c69f6d06ef55', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:17:01 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-cf906440-34fc-4e3d-9311-048b5deddda7 req-f14389f0-ee83-4f0c-a544-6d8b40d29c81 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] attachment_update completed successfully. Sep 01 02:17:01 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b.72bb7a60-ae02-429c-906f-1024e1995553" returned: 0 in 0.265s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-72bb7a60-ae02-429c-906f-1024e1995553" released by "_delete_snapshot" :: held 1.846s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-0f8c3aed-9f9a-415d-813d-1cf36571292b" released by "delete_snapshot" :: held 1.873s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:01 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Created reservations ['38847857-5957-45cf-af09-949674b45297', '8aca79cf-c19a-4d1f-be01-b79a8f507276', '757456c4-6c0e-413a-a667-952d521a1181', '2e6b683f-ce23-4ec3-837b-fa0b22e64304'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:02 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Delete snapshot completed successfully. Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-72bb7a60-ae02-429c-906f-1024e1995553-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Snapshots deleted, issuing volume delete {{(pid=87389) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-quobyte-0f8c3aed-9f9a-415d-813d-1cf36571292b" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-0f8c3aed-9f9a-415d-813d-1cf36571292b" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded2976a-4396-436d-b656-4e9cdae41b53]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:02 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b Sep 01 02:17:02 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:02 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b" returned: 0 in 0.424s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:02 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b Sep 01 02:17:02 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:02 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0f8c3aed-9f9a-415d-813d-1cf36571292b" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-0f8c3aed-9f9a-415d-813d-1cf36571292b" released by "delete_volume" :: held 0.781s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Created reservations ['9cf9e292-3aa6-4e93-86ec-f4169cae8840', 'afbc1004-8341-4bf9-8261-ecbb73b48963', '13c18c7d-a750-4998-bc23-f3d9682c4eb8', 'a23b2137-5f8e-4497-b15f-eae88ff793be'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:03 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:03 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:03 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:03 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:03 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Deleted volume successfully. Sep 01 02:17:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2a336113-83db-44f1-83e1-c03bcb8ce953 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-0f8c3aed-9f9a-415d-813d-1cf36571292b-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-f34e2f3e-5c63-46d6-9a7d-8097088728f8-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-f34e2f3e-5c63-46d6-9a7d-8097088728f8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "cinder-quobyte-f34e2f3e-5c63-46d6-9a7d-8097088728f8" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-f34e2f3e-5c63-46d6-9a7d-8097088728f8" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:03 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f803604-c8e6-4586-96fe-6588f01a4e3d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:03 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 Sep 01 02:17:03 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:03 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8" returned: 0 in 0.398s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:03 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8 Sep 01 02:17:03 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:04 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f34e2f3e-5c63-46d6-9a7d-8097088728f8" returned: 0 in 0.265s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-quobyte-f34e2f3e-5c63-46d6-9a7d-8097088728f8" released by "delete_volume" :: held 0.712s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Created reservations ['22668857-366f-4762-be78-333c40626547', '1f2a470e-30a0-4c5b-958d-8b335f244d81', '7532b26d-2d37-4243-b957-e280473bf50f', 'f434bbb1-ae50-40e9-8de6-be7d5d0a02f9'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:04 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:04 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:04 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.266s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:04 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Deleted volume successfully. Sep 01 02:17:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5310194b-c313-4208-931d-c60f95101715 tempest-VolumesDeleteCascade-406997109 None] Lock "cinder-f34e2f3e-5c63-46d6-9a7d-8097088728f8-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:05 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-966ca58c-ea01-4c4e-a9dc-93e30878b120 req-3f22ff73-6a32-4c6b-956c-9a8fcd3fce21 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Terminate volume connection completed successfully. Sep 01 02:17:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-966ca58c-ea01-4c4e-a9dc-93e30878b120 req-3f22ff73-6a32-4c6b-956c-9a8fcd3fce21 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Deleting attachment 3276a7d9-6355-4f57-a296-c69f6d06ef55. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:17:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Acquiring lock "cinder-a38e2792-6626-43ab-a44a-6f33345fb832-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "cinder-a38e2792-6626-43ab-a44a-6f33345fb832-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Acquiring lock "cinder-quobyte-a38e2792-6626-43ab-a44a-6f33345fb832" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "cinder-quobyte-a38e2792-6626-43ab-a44a-6f33345fb832" acquired by "delete_volume" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:06 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6d6d88-ed87-4439-a1c4-9748e4493ca3]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:06 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832 Sep 01 02:17:06 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:06 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832" returned: 0 in 0.403s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:06 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832 Sep 01 02:17:06 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:06 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a38e2792-6626-43ab-a44a-6f33345fb832" returned: 0 in 0.258s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "cinder-quobyte-a38e2792-6626-43ab-a44a-6f33345fb832" released by "delete_volume" :: held 0.706s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:06 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Created reservations ['5735ef75-a338-43b3-b57b-192d90640422', 'a3ae0de3-4579-4aa7-8029-efb664625a8b', 'd52128e5-72aa-4fa1-a4dc-dd42dd576e55', 'a66f9c10-da10-4374-a510-af790220b943'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:07 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:07 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:07 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.276s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:07 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:07 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Deleted volume successfully. Sep 01 02:17:07 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eccc33a5-413e-4d5a-bebb-91da88ec6ef0 tempest-TestServerVolumeAttachScenarioOldVersion-126369967 None] Lock "cinder-a38e2792-6626-43ab-a44a-6f33345fb832-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Flow 'volume_create_manager' (aaffac4f-acc6-478f-a4d7-a357a2622105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c36460-3289-4cd7-8d37-8db218a78dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c36460-3289-4cd7-8d37-8db218a78dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1450702071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fb4635-9565-460f-b54e-3097ac4842dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a592fabf01b84d69888ff1cf635924c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:08Z,use_quota=True,user_id='0d5aebec95c3446db6f64d762fbcdbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdeac7c-9350-42cf-8f59-100475ee1c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fdeac7c-9350-42cf-8f59-100475ee1c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc9b305-d8d2-4564-9c38-b1499b7e1d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc9b305-d8d2-4564-9c38-b1499b7e1d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2fb4635-9565-460f-b54e-3097ac4842dd', 'volume_name': 'volume-f2fb4635-9565-460f-b54e-3097ac4842dd', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b043061-90b1-483d-a610-a4f94725c895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b043061-90b1-483d-a610-a4f94725c895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea64c268-4f8c-42dc-a226-c74509308df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:08 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Volume f2fb4635-9565-460f-b54e-3097ac4842dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2fb4635-9565-460f-b54e-3097ac4842dd', 'volume_size': 1} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1450702071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2fb4635-9565-460f-b54e-3097ac4842dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a592fabf01b84d69888ff1cf635924c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:08Z,use_quota=True,user_id='0d5aebec95c3446db6f64d762fbcdbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Creating volume f2fb4635-9565-460f-b54e-3097ac4842dd {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:08 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:08 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd 1073741824 Sep 01 02:17:08 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd 1073741824" returned: 0 in 0.535s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:08 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:08 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd Sep 01 02:17:08 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:09 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd" returned: 0 in 0.266s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea64c268-4f8c-42dc-a226-c74509308df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2fb4635-9565-460f-b54e-3097ac4842dd', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4f5f05-1f3c-46fe-9e8e-0d37970d052c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:09 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Volume volume-f2fb4635-9565-460f-b54e-3097ac4842dd (f2fb4635-9565-460f-b54e-3097ac4842dd): created successfully Sep 01 02:17:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e4f5f05-1f3c-46fe-9e8e-0d37970d052c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Flow 'volume_create_manager' (aaffac4f-acc6-478f-a4d7-a357a2622105) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:09 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-abdb3b94-307f-4306-a411-083a00bd5fae tempest-VolumesCloneTest-621177741 None] Created volume successfully. Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Flow 'volume_create_manager' (8dcbc13b-9fd4-4397-8737-a3ded2a83ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d5c25f-6d44-4d3d-9c24-ceab5d673a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25d5c25f-6d44-4d3d-9c24-ceab5d673a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-663463977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=784f0047-9477-480e-8a1d-2c612e8cf32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a592fabf01b84d69888ff1cf635924c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f2fb4635-9565-460f-b54e-3097ac4842dd,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:11Z,use_quota=True,user_id='0d5aebec95c3446db6f64d762fbcdbb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e926a16-0555-4869-b317-cc52c559ad50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e926a16-0555-4869-b317-cc52c559ad50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a24302-0b04-4901-906f-cdd6fb3b5486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a24302-0b04-4901-906f-cdd6fb3b5486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '784f0047-9477-480e-8a1d-2c612e8cf32c', 'volume_name': 'volume-784f0047-9477-480e-8a1d-2c612e8cf32c', 'volume_size': 2, 'source_volid': 'f2fb4635-9565-460f-b54e-3097ac4842dd', 'source_volstatus': 'available'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947e209c-7364-4f99-b82a-4bcc0799a61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (947e209c-7364-4f99-b82a-4bcc0799a61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4696f3-2b89-40ab-bfdd-01fd1db3df3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:10 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Volume 784f0047-9477-480e-8a1d-2c612e8cf32c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-784f0047-9477-480e-8a1d-2c612e8cf32c', 'volume_size': 2, 'source_volid': 'f2fb4635-9565-460f-b54e-3097ac4842dd', 'source_volstatus': 'available'} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:10 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Cloning volume f2fb4635-9565-460f-b54e-3097ac4842dd to volume 784f0047-9477-480e-8a1d-2c612e8cf32c Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Creating offline snapshot 7f396238-78b7-4422-be9f-349f760ff59a of volume f2fb4635-9565-460f-b54e-3097ac4842dd {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1bf3ce-7738-45a4-afc3-9cee435112df]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:10 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd Sep 01 02:17:10 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:11 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd" returned: 0 in 0.385s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:11 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a 1G Sep 01 02:17:11 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:11 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a 1G" returned: 0 in 0.446s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fb4635-9565-460f-b54e-3097ac4842dd -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:11 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fb4635-9565-460f-b54e-3097ac4842dd -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a Sep 01 02:17:11 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:12 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2fb4635-9565-460f-b54e-3097ac4842dd -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a" returned: 0 in 0.335s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:12 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a is being set with open permissions: ugo+rw Sep 01 02:17:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:12 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a Sep 01 02:17:12 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:12 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a" returned: 0 in 0.277s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:12 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.info Sep 01 02:17:12 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:12 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.info" returned: 0 in 0.352s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:12 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.info is being set with open permissions: ugo+rw Sep 01 02:17:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:12 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.info Sep 01 02:17:12 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:13 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.info" returned: 0 in 0.306s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Acquiring lock "cinder-quobyte-784f0047-9477-480e-8a1d-2c612e8cf32c" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Lock "cinder-quobyte-784f0047-9477-480e-8a1d-2c612e8cf32c" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] snapshot: 7f396238-78b7-4422-be9f-349f760ff59a, volume: 784f0047-9477-480e-8a1d-2c612e8cf32c, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be56dc9-3de9-4017-b7f4-096e63e60dce]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:13 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a Sep 01 02:17:13 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:13 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a" returned: 0 in 0.427s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2fb4635-9565-460f-b54e-3097ac4842dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3677f4d6-eec1-4ef0-9ffb-6689c2411199]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:13 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd Sep 01 02:17:13 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:14 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd" returned: 0 in 0.540s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:17:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:17:14 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:17:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:14 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c Sep 01 02:17:14 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:19 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c" returned: 0 in 5.302s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:19 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:17:19 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Converted 1024.00 MB image at 193.08 MB/s Sep 01 02:17:19 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c is being set with open permissions: ugo+rw Sep 01 02:17:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:19 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c Sep 01 02:17:19 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:19 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c" returned: 0 in 0.309s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Lock "cinder-quobyte-784f0047-9477-480e-8a1d-2c612e8cf32c" released by "_copy_volume_from_snapshot" :: held 6.702s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Acquiring lock "cinder-quobyte-7f396238-78b7-4422-be9f-349f760ff59a" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Lock "cinder-quobyte-7f396238-78b7-4422-be9f-349f760ff59a" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Deleting offline snapshot 7f396238-78b7-4422-be9f-349f760ff59a of volume f2fb4635-9565-460f-b54e-3097ac4842dd {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] snapshot_file for this snap is: volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:19 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5659f9-4dd4-4f5f-aa20-6b7ba19e8228]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a Sep 01 02:17:20 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:20 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a" returned: 0 in 0.464s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2fb4635-9565-460f-b54e-3097ac4842dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:20 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59d0e0c-e495-4f4d-9dba-39c8546738fc]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd Sep 01 02:17:20 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:20 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd" returned: 0 in 0.536s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:20 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a Sep 01 02:17:20 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:21 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a" returned: 0 in 0.363s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:21 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a Sep 01 02:17:21 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:21 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd.7f396238-78b7-4422-be9f-349f760ff59a" returned: 0 in 0.286s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Lock "cinder-quobyte-7f396238-78b7-4422-be9f-349f760ff59a" released by "_delete_snapshot" :: held 1.744s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.806s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4696f3-2b89-40ab-bfdd-01fd1db3df3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-784f0047-9477-480e-8a1d-2c612e8cf32c', 'volume_size': 2, 'source_volid': 'f2fb4635-9565-460f-b54e-3097ac4842dd', 'source_volstatus': 'available'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57abfedc-b8aa-4866-bb14-6ea1a8b91913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:21 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Volume volume-784f0047-9477-480e-8a1d-2c612e8cf32c (784f0047-9477-480e-8a1d-2c612e8cf32c): created successfully Sep 01 02:17:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57abfedc-b8aa-4866-bb14-6ea1a8b91913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Flow 'volume_create_manager' (8dcbc13b-9fd4-4397-8737-a3ded2a83ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e16cebb2-ef19-4962-8529-926e544d2c68 tempest-VolumesCloneTest-621177741 None] Created volume successfully. Sep 01 02:17:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Acquiring lock "cinder-784f0047-9477-480e-8a1d-2c612e8cf32c-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Lock "cinder-784f0047-9477-480e-8a1d-2c612e8cf32c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Acquiring lock "cinder-quobyte-784f0047-9477-480e-8a1d-2c612e8cf32c" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Lock "cinder-quobyte-784f0047-9477-480e-8a1d-2c612e8cf32c" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[77fd0e04-77d7-4ea3-b912-b6993db4f04e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:23 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c Sep 01 02:17:23 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:23 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c" returned: 0 in 0.390s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:23 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c Sep 01 02:17:23 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:23 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-784f0047-9477-480e-8a1d-2c612e8cf32c" returned: 0 in 0.251s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Lock "cinder-quobyte-784f0047-9477-480e-8a1d-2c612e8cf32c" released by "delete_volume" :: held 0.683s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Created reservations ['85a5fcb0-588d-4240-938a-f02aa881da7a', '6c57079e-de08-4b43-835f-d35628accd37', '7fe99b75-a446-4aad-8f83-0d1eb20dcd5c', 'c9ca507e-e0ef-4a31-9adb-59c635766954'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:23 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:23 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:24 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.269s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:24 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:24 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Deleted volume successfully. Sep 01 02:17:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0acbe5ac-4d68-4fb1-a8c7-032a2c8e7c26 tempest-VolumesCloneTest-621177741 None] Lock "cinder-784f0047-9477-480e-8a1d-2c612e8cf32c-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Acquiring lock "cinder-f2fb4635-9565-460f-b54e-3097ac4842dd-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Lock "cinder-f2fb4635-9565-460f-b54e-3097ac4842dd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Acquiring lock "cinder-quobyte-f2fb4635-9565-460f-b54e-3097ac4842dd" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Lock "cinder-quobyte-f2fb4635-9565-460f-b54e-3097ac4842dd" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:24 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96e88e1-b42e-449b-96f9-110bfe3bf996]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:24 devstack sudo[101987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd Sep 01 02:17:24 devstack sudo[101987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:24 devstack sudo[101987]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd" returned: 0 in 0.382s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:24 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd Sep 01 02:17:24 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:25 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f2fb4635-9565-460f-b54e-3097ac4842dd" returned: 0 in 0.270s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Lock "cinder-quobyte-f2fb4635-9565-460f-b54e-3097ac4842dd" released by "delete_volume" :: held 0.723s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Created reservations ['650ad665-567e-403d-9cf1-a774938e2be8', '103808e8-33be-4691-a86e-bed5735b1c7a', '4fcbd82d-65de-4c89-95b0-cb52e9e31f24', 'adc3e47c-bada-4005-9390-0b99995126fa'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:25 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:25 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:25 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.263s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Deleted volume successfully. Sep 01 02:17:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f714194c-2c32-42fd-a846-7050cb30035f tempest-VolumesCloneTest-621177741 None] Lock "cinder-f2fb4635-9565-460f-b54e-3097ac4842dd-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-7a8f3d78-673b-4dbb-9afc-bbe3b57334ee req-9b354d70-49d2-45f5-ade1-ba5174e51b53 tempest-TestStampPattern-138466576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-7a8f3d78-673b-4dbb-9afc-bbe3b57334ee req-9b354d70-49d2-45f5-ade1-ba5174e51b53 tempest-TestStampPattern-138466576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-7a8f3d78-673b-4dbb-9afc-bbe3b57334ee req-9b354d70-49d2-45f5-ade1-ba5174e51b53 tempest-TestStampPattern-138466576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-7a8f3d78-673b-4dbb-9afc-bbe3b57334ee req-9b354d70-49d2-45f5-ade1-ba5174e51b53 tempest-TestStampPattern-138466576 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b16c6b2f-f0c5-4d59-ba3f-663af85a63d6', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:17:28 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-7a8f3d78-673b-4dbb-9afc-bbe3b57334ee req-9b354d70-49d2-45f5-ade1-ba5174e51b53 tempest-TestStampPattern-138466576 None] attachment_update completed successfully. Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Flow 'volume_create_manager' (b7081cbb-f807-4eef-812d-1027c05bd52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7682686f-852b-4315-bbb5-e6ac13c14b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7682686f-852b-4315-bbb5-e6ac13c14b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-233437201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b9024e-c815-4d30-b215-533c0ffe697e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337f012323aa4189b3d9386123d108c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:29Z,use_quota=True,user_id='f23423844efe4f5a9cb9c574b689354b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f297b7d-7945-4c8e-9e4e-12967e4fe9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f297b7d-7945-4c8e-9e4e-12967e4fe9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa00cc3-59dd-4596-a829-c5f8c0c5ee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa00cc3-59dd-4596-a829-c5f8c0c5ee91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02b9024e-c815-4d30-b215-533c0ffe697e', 'volume_name': 'volume-02b9024e-c815-4d30-b215-533c0ffe697e', 'volume_size': 2}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc51623d-baf4-4cb3-837d-036c2215903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc51623d-baf4-4cb3-837d-036c2215903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a9c1bd-f183-4764-8fb4-415713f1dd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:29 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Volume 02b9024e-c815-4d30-b215-533c0ffe697e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02b9024e-c815-4d30-b215-533c0ffe697e', 'volume_size': 2} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-233437201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02b9024e-c815-4d30-b215-533c0ffe697e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='337f012323aa4189b3d9386123d108c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:29Z,use_quota=True,user_id='f23423844efe4f5a9cb9c574b689354b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Creating volume 02b9024e-c815-4d30-b215-533c0ffe697e {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:29 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e 2147483648 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:29 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e 2147483648 Sep 01 02:17:29 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:29 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e 2147483648" returned: 0 in 0.691s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:29 devstack sudo[102437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e Sep 01 02:17:29 devstack sudo[102437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:30 devstack sudo[102437]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e" returned: 0 in 0.265s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a9c1bd-f183-4764-8fb4-415713f1dd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02b9024e-c815-4d30-b215-533c0ffe697e', 'volume_size': 2}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03355029-0bff-478f-8e8c-10fcd99d4b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:30 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Volume volume-02b9024e-c815-4d30-b215-533c0ffe697e (02b9024e-c815-4d30-b215-533c0ffe697e): created successfully Sep 01 02:17:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03355029-0bff-478f-8e8c-10fcd99d4b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:30 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Flow 'volume_create_manager' (b7081cbb-f807-4eef-812d-1027c05bd52e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:30 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-df343bd6-7d2d-46fd-bb90-3b6510abd520 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Created volume successfully. Sep 01 02:17:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Creating offline snapshot c7b8fa9d-a601-4916-8378-f83185fb21b3 of volume 02b9024e-c815-4d30-b215-533c0ffe697e {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:17:31 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad690b42-d1f8-4ece-9734-4ef1d1b8fa07]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:31 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e Sep 01 02:17:31 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:31 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e" returned: 0 in 0.443s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 2G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:31 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 2G Sep 01 02:17:31 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:32 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-f89ff4af-3683-4f3e-b6ca-3ffd40890fe2 req-502a1db6-9f72-4391-a668-0abc1a389fa6 tempest-TestStampPattern-138466576 None] Terminate volume connection completed successfully. Sep 01 02:17:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-f89ff4af-3683-4f3e-b6ca-3ffd40890fe2 req-502a1db6-9f72-4391-a668-0abc1a389fa6 tempest-TestStampPattern-138466576 None] Deleting attachment b16c6b2f-f0c5-4d59-ba3f-663af85a63d6. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:17:32 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 2G" returned: 0 in 0.592s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b9024e-c815-4d30-b215-533c0ffe697e -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:32 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b9024e-c815-4d30-b215-533c0ffe697e -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 Sep 01 02:17:32 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:32 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02b9024e-c815-4d30-b215-533c0ffe697e -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3" returned: 0 in 0.327s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:32 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 is being set with open permissions: ugo+rw Sep 01 02:17:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:32 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 Sep 01 02:17:32 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:33 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3" returned: 0 in 0.273s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:33 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.info Sep 01 02:17:33 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:33 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.info" returned: 0 in 0.314s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:33 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.info is being set with open permissions: ugo+rw Sep 01 02:17:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:33 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.info Sep 01 02:17:33 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:33 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.info" returned: 0 in 0.290s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.377s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:33 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5d1b6d05-ff62-4831-8e71-7f51988cf33c tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Create snapshot completed successfully Sep 01 02:17:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Acquiring lock "cinder-c7b8fa9d-a601-4916-8378-f83185fb21b3-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "cinder-c7b8fa9d-a601-4916-8378-f83185fb21b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Acquiring lock "cinder-quobyte-02b9024e-c815-4d30-b215-533c0ffe697e" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "cinder-quobyte-02b9024e-c815-4d30-b215-533c0ffe697e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Acquiring lock "cinder-quobyte-c7b8fa9d-a601-4916-8378-f83185fb21b3" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "cinder-quobyte-c7b8fa9d-a601-4916-8378-f83185fb21b3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Deleting offline snapshot c7b8fa9d-a601-4916-8378-f83185fb21b3 of volume 02b9024e-c815-4d30-b215-533c0ffe697e {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] snapshot_file for this snap is: volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:34 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[866e2e95-da99-4f19-a8f5-4126848cfcd8]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:34 devstack sudo[102511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 Sep 01 02:17:34 devstack sudo[102511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:35 devstack sudo[102511]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3" returned: 0 in 0.697s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02b9024e-c815-4d30-b215-533c0ffe697e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:35 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[18193b85-d663-4ef8-a43a-d1c492096ed4]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:35 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e Sep 01 02:17:35 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:36 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e" returned: 0 in 0.505s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:36 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 Sep 01 02:17:36 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:36 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3" returned: 0 in 0.372s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:36 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3 Sep 01 02:17:36 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:36 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e.c7b8fa9d-a601-4916-8378-f83185fb21b3" returned: 0 in 0.305s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "cinder-quobyte-c7b8fa9d-a601-4916-8378-f83185fb21b3" released by "_delete_snapshot" :: held 2.071s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "cinder-quobyte-02b9024e-c815-4d30-b215-533c0ffe697e" released by "delete_snapshot" :: held 2.109s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:36 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Created reservations ['f74bfef7-d353-4b5d-9d9a-0a3173362458', '49ca4aba-82af-4310-8a6c-dca0041e914d', '2b4cec4c-32ce-4d55-b2b1-eaf13f706127', '2493fa31-daa2-4740-8676-926efee90f4e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:36 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Delete snapshot completed successfully. Sep 01 02:17:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c3c14f91-5a01-4f9c-a1d7-237570d161fd tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "cinder-c7b8fa9d-a601-4916-8378-f83185fb21b3-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:37 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Acquiring lock "cinder-02b9024e-c815-4d30-b215-533c0ffe697e-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:37 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "cinder-02b9024e-c815-4d30-b215-533c0ffe697e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Acquiring lock "cinder-quobyte-02b9024e-c815-4d30-b215-533c0ffe697e" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "cinder-quobyte-02b9024e-c815-4d30-b215-533c0ffe697e" acquired by "delete_volume" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e66dac-6a4f-4ad7-8a8d-aeb9e5df7b74]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Acquiring lock "cinder-538224d7-8fe1-4fb3-b93f-9bbfbb018624-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Lock "cinder-538224d7-8fe1-4fb3-b93f-9bbfbb018624-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:38 devstack sudo[102555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e Sep 01 02:17:38 devstack sudo[102555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Acquiring lock "cinder-quobyte-538224d7-8fe1-4fb3-b93f-9bbfbb018624" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-538224d7-8fe1-4fb3-b93f-9bbfbb018624" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea930bfb-8a7e-4933-b705-71e5e45b59c0]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:38 devstack sudo[102557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 Sep 01 02:17:38 devstack sudo[102557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:38 devstack sudo[102555]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e" returned: 0 in 0.479s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:38 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e Sep 01 02:17:38 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:38 devstack sudo[102557]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624" returned: 0 in 0.401s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:38 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624 Sep 01 02:17:38 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:38 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-02b9024e-c815-4d30-b215-533c0ffe697e" returned: 0 in 0.265s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "cinder-quobyte-02b9024e-c815-4d30-b215-533c0ffe697e" released by "delete_volume" :: held 0.819s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Created reservations ['82701a65-331b-456d-8b29-439903b94105', '08874a72-9bdd-4450-9fc9-cc9e536f8571', '4ca704a9-f13c-4944-af57-37dd7cda8980', 'fc179e4e-ffc4-4007-81cf-13b7993becef'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:38 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-538224d7-8fe1-4fb3-b93f-9bbfbb018624" returned: 0 in 0.275s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-538224d7-8fe1-4fb3-b93f-9bbfbb018624" released by "delete_volume" :: held 0.739s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:39 devstack sudo[102571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:39 devstack sudo[102571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Created reservations ['2fd2bc1c-9ff5-4739-8061-f82ac7331f2b', '2ba51535-6c87-48f6-82b2-dcedee28ca80', '7107e20c-1746-4953-8a02-7422781ca929', 'c04f8f35-c80c-4a54-a6d8-1c9f01e60c03'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:39 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:39 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:39 devstack sudo[102571]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.350s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Deleted volume successfully. Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fee11cd-d9fb-47a3-a94c-7146b502f820 tempest-VolumesSnapshotNegativeTestJSON-2028468465 None] Lock "cinder-02b9024e-c815-4d30-b215-533c0ffe697e-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:39 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.346s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Deleted volume successfully. Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c04f2146-08dc-41da-9215-b2b08413f99c tempest-TestStampPattern-138466576 None] Lock "cinder-538224d7-8fe1-4fb3-b93f-9bbfbb018624-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Acquiring lock "cinder-1dbdc2b5-0bce-4d60-8f6e-77267a51096d-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Lock "cinder-1dbdc2b5-0bce-4d60-8f6e-77267a51096d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Acquiring lock "cinder-quobyte-63bcc40d-bd96-4c18-85b1-2a1d192db892" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-63bcc40d-bd96-4c18-85b1-2a1d192db892" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Acquiring lock "cinder-quobyte-1dbdc2b5-0bce-4d60-8f6e-77267a51096d" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-1dbdc2b5-0bce-4d60-8f6e-77267a51096d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Deleting offline snapshot 1dbdc2b5-0bce-4d60-8f6e-77267a51096d of volume 63bcc40d-bd96-4c18-85b1-2a1d192db892 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] snapshot_file for this snap is: volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5792060-8de8-44f7-862d-bd72542c5fca]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:39 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d Sep 01 02:17:39 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:40 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d" returned: 0 in 0.446s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63bcc40d-bd96-4c18-85b1-2a1d192db892(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53d88ac-2002-4528-9e1d-2cda90aceaea]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:40 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 Sep 01 02:17:40 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Flow 'volume_create_manager' (f43b18e3-abb6-4b33-9a74-dd7a4d035724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02608814-908c-4121-86bb-5e35cc2cea16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02608814-908c-4121-86bb-5e35cc2cea16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1057135792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d12142e-10b8-4c94-bf29-3a7c8b699eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3297da3a5240b5b551abac08a8d0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:41Z,use_quota=True,user_id='16dade51efa4483e9768e5e7d5d34b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2268515-b783-44a0-ab1a-ec34eee0bb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2268515-b783-44a0-ab1a-ec34eee0bb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff231512-1ad2-4347-b078-61794c4cf466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff231512-1ad2-4347-b078-61794c4cf466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d12142e-10b8-4c94-bf29-3a7c8b699eda', 'volume_name': 'volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16943125-a8cf-417d-8e0d-1d4f474f9e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16943125-a8cf-417d-8e0d-1d4f474f9e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e23d3ec-b31f-455b-8a6c-edb9107f4334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:40 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Volume 7d12142e-10b8-4c94-bf29-3a7c8b699eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda', 'volume_size': 1} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1057135792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d12142e-10b8-4c94-bf29-3a7c8b699eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3297da3a5240b5b551abac08a8d0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:41Z,use_quota=True,user_id='16dade51efa4483e9768e5e7d5d34b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Creating volume 7d12142e-10b8-4c94-bf29-3a7c8b699eda {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:40 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:17:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:40 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda 1073741824 Sep 01 02:17:40 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:41 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892" returned: 0 in 0.687s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:41 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d Sep 01 02:17:41 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:41 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda 1073741824" returned: 0 in 0.529s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:41 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda Sep 01 02:17:41 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:41 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d" returned: 0 in 0.386s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:41 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d Sep 01 02:17:41 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:41 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda" returned: 0 in 0.289s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e23d3ec-b31f-455b-8a6c-edb9107f4334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a5675c-9c37-4c3e-a27d-680caab62abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=101,cinder:SELECT=75,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:41 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Volume volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda (7d12142e-10b8-4c94-bf29-3a7c8b699eda): created successfully Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a5675c-9c37-4c3e-a27d-680caab62abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Flow 'volume_create_manager' (f43b18e3-abb6-4b33-9a74-dd7a4d035724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ece38062-679c-4399-b6ae-c1a081a97619 tempest-ProjectReaderTests-603839290 None] Created volume successfully. Sep 01 02:17:41 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892.1dbdc2b5-0bce-4d60-8f6e-77267a51096d" returned: 0 in 0.307s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-1dbdc2b5-0bce-4d60-8f6e-77267a51096d" released by "_delete_snapshot" :: held 1.957s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-63bcc40d-bd96-4c18-85b1-2a1d192db892" released by "delete_snapshot" :: held 1.981s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Created reservations ['6c6ebf2f-3279-4c6f-8154-8af7c2aa3944', '0219dd41-3944-460f-a45e-b203e24e919e', '2ed85eb3-ea27-423b-aa56-8ef56087dea5', '2850f6c0-f14c-45bb-929b-3d2fc54b2cce'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Delete snapshot completed successfully. Sep 01 02:17:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d09f5ff8-712d-4267-a949-13397279482d tempest-TestStampPattern-138466576 None] Lock "cinder-1dbdc2b5-0bce-4d60-8f6e-77267a51096d-delete_snapshot" released by "delete_snapshot" :: held 2.145s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Acquiring lock "cinder-7d12142e-10b8-4c94-bf29-3a7c8b699eda-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Lock "cinder-7d12142e-10b8-4c94-bf29-3a7c8b699eda-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Acquiring lock "cinder-quobyte-7d12142e-10b8-4c94-bf29-3a7c8b699eda" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Lock "cinder-quobyte-7d12142e-10b8-4c94-bf29-3a7c8b699eda" acquired by "delete_volume" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:43 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac900313-6acb-49d9-810f-45ede17a30fa]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:43 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda Sep 01 02:17:43 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:43 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda" returned: 0 in 0.482s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:43 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda Sep 01 02:17:43 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:43 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7d12142e-10b8-4c94-bf29-3a7c8b699eda" returned: 0 in 0.329s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Lock "cinder-quobyte-7d12142e-10b8-4c94-bf29-3a7c8b699eda" released by "delete_volume" :: held 0.880s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:43 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=108,cinder:UPDATE=102,cinder:DELETE=9,cinder:INSERT=24 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:17:43 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Created reservations ['ff2941da-96e2-4627-ac2d-91b6de8898c2', '977d7bc4-3f36-4414-92b5-78ec1f5b7732', '6dccbbd6-0125-461c-87d0-4c47626c1b0e', '85910782-c60d-43e4-93d7-311a3ed99e64'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:44 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:44 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:44 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.523s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:44 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:44 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Deleted volume successfully. Sep 01 02:17:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4000252d-8564-4fc2-953f-a8e273e0b7c6 tempest-ProjectReaderTests-603839290 None] Lock "cinder-7d12142e-10b8-4c94-bf29-3a7c8b699eda-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Flow 'volume_create_manager' (808b1863-9135-45a8-a5d0-fb7b7bc4192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be5a9e5-2b83-404c-a358-9fcec4db901d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be5a9e5-2b83-404c-a358-9fcec4db901d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520257736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ba0b81-6baa-4694-9ea5-e51826e1a74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3297da3a5240b5b551abac08a8d0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:45Z,use_quota=True,user_id='16dade51efa4483e9768e5e7d5d34b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5819c8c9-89d3-4222-8d65-df11555c3591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5819c8c9-89d3-4222-8d65-df11555c3591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d9119a-3ff7-4df3-939a-73e62cdd1a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47d9119a-3ff7-4df3-939a-73e62cdd1a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7ba0b81-6baa-4694-9ea5-e51826e1a74c', 'volume_name': 'volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481500a6-5576-4671-b2b7-ec96a00bc5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (481500a6-5576-4671-b2b7-ec96a00bc5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c71d717-860a-46ee-8b6b-ab78592d05ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:45 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Volume b7ba0b81-6baa-4694-9ea5-e51826e1a74c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c', 'volume_size': 1} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520257736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ba0b81-6baa-4694-9ea5-e51826e1a74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3297da3a5240b5b551abac08a8d0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:45Z,use_quota=True,user_id='16dade51efa4483e9768e5e7d5d34b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Creating volume b7ba0b81-6baa-4694-9ea5-e51826e1a74c {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:45 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:45 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c 1073741824 Sep 01 02:17:45 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:45 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c 1073741824" returned: 0 in 0.555s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:45 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c Sep 01 02:17:45 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:46 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c" returned: 0 in 0.322s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c71d717-860a-46ee-8b6b-ab78592d05ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc7c225-8a42-4679-9397-3bffc6eddedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:46 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Volume volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c (b7ba0b81-6baa-4694-9ea5-e51826e1a74c): created successfully Sep 01 02:17:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcc7c225-8a42-4679-9397-3bffc6eddedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Flow 'volume_create_manager' (808b1863-9135-45a8-a5d0-fb7b7bc4192b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:46 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3c61981f-17c0-4ac3-8c13-a4f9590fcc29 tempest-ProjectReaderTests-603839290 None] Created volume successfully. Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Acquiring lock "cinder-b7ba0b81-6baa-4694-9ea5-e51826e1a74c-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Lock "cinder-b7ba0b81-6baa-4694-9ea5-e51826e1a74c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Acquiring lock "cinder-quobyte-b7ba0b81-6baa-4694-9ea5-e51826e1a74c" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:47 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:47 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Lock "cinder-quobyte-b7ba0b81-6baa-4694-9ea5-e51826e1a74c" acquired by "delete_volume" :: waited 0.058s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9422fac2-6c15-4793-a8fb-254a94ccf26b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:47 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c Sep 01 02:17:47 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:47 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.382s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:17:47 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c" returned: 0 in 0.509s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:47 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c Sep 01 02:17:47 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Acquiring lock "cinder-63bcc40d-bd96-4c18-85b1-2a1d192db892-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Lock "cinder-63bcc40d-bd96-4c18-85b1-2a1d192db892-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Acquiring lock "cinder-quobyte-63bcc40d-bd96-4c18-85b1-2a1d192db892" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-63bcc40d-bd96-4c18-85b1-2a1d192db892" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd56b80-7d16-48a1-8e10-4ec4f52eb660]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:48 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b7ba0b81-6baa-4694-9ea5-e51826e1a74c" returned: 0 in 0.324s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Lock "cinder-quobyte-b7ba0b81-6baa-4694-9ea5-e51826e1a74c" released by "delete_volume" :: held 0.919s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:48 devstack sudo[102661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 Sep 01 02:17:48 devstack sudo[102661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Created reservations ['bf5ddad3-af00-4171-8d6e-fc510adf1ee0', '49c811ce-e907-4131-bb26-24356748d83d', 'ffd8bee0-c1c9-4e9e-88c5-a04ced258120', 'ec949927-9424-4b42-a076-06a0d9683983'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:48 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:48 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:48 devstack sudo[102661]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892" returned: 0 in 0.434s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:48 devstack sudo[102669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892 Sep 01 02:17:48 devstack sudo[102669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:48 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.295s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Deleted volume successfully. Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7d99af6a-a7ce-4021-94e8-03ccfaa84497 tempest-ProjectReaderTests-603839290 None] Lock "cinder-b7ba0b81-6baa-4694-9ea5-e51826e1a74c-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:48 devstack sudo[102669]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-63bcc40d-bd96-4c18-85b1-2a1d192db892" returned: 0 in 0.403s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Lock "cinder-quobyte-63bcc40d-bd96-4c18-85b1-2a1d192db892" released by "delete_volume" :: held 0.917s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:49 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Created reservations ['8095b1e8-c22c-4c79-aafe-34b84c1273d5', '714cfe0f-7906-4b95-aa04-61f3f8223bae', '88ed4ab5-a512-4716-88c1-45cac87ebf2e', '312312f4-23cb-4655-b28a-986c63306e64'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:49 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:49 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:49 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.256s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:49 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:49 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Deleted volume successfully. Sep 01 02:17:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d1c7fe95-6276-4fb6-afdf-cf3d35c85b11 tempest-TestStampPattern-138466576 None] Lock "cinder-63bcc40d-bd96-4c18-85b1-2a1d192db892-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Flow 'volume_create_manager' (ddc8033b-159e-4589-a430-42266e796f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1e989b-7177-4d61-ace0-943fc6468743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f1e989b-7177-4d61-ace0-943fc6468743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804678973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24c38a7-a17b-447c-a363-b46a15b39b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3297da3a5240b5b551abac08a8d0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:50Z,use_quota=True,user_id='16dade51efa4483e9768e5e7d5d34b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d85564-bf8c-4ef8-b4d9-52aa02711292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6d85564-bf8c-4ef8-b4d9-52aa02711292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d761bec1-80e4-422c-9987-fac227d2e181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d761bec1-80e4-422c-9987-fac227d2e181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24c38a7-a17b-447c-a363-b46a15b39b44', 'volume_name': 'volume-a24c38a7-a17b-447c-a363-b46a15b39b44', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097abc98-37b3-4b80-b026-e8ecce43c65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097abc98-37b3-4b80-b026-e8ecce43c65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539a8d85-9a5b-49f6-a676-b36af786c8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:50 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Volume a24c38a7-a17b-447c-a363-b46a15b39b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24c38a7-a17b-447c-a363-b46a15b39b44', 'volume_size': 1} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1804678973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24c38a7-a17b-447c-a363-b46a15b39b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3297da3a5240b5b551abac08a8d0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:50Z,use_quota=True,user_id='16dade51efa4483e9768e5e7d5d34b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Creating volume a24c38a7-a17b-447c-a363-b46a15b39b44 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:50 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:50 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44 1073741824 Sep 01 02:17:50 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:50 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44 1073741824" returned: 0 in 0.537s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:50 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44 Sep 01 02:17:50 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:51 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44" returned: 0 in 0.353s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539a8d85-9a5b-49f6-a676-b36af786c8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24c38a7-a17b-447c-a363-b46a15b39b44', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a65ee44-7f83-4914-80d5-bd3d98968677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:51 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Volume volume-a24c38a7-a17b-447c-a363-b46a15b39b44 (a24c38a7-a17b-447c-a363-b46a15b39b44): created successfully Sep 01 02:17:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a65ee44-7f83-4914-80d5-bd3d98968677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Flow 'volume_create_manager' (ddc8033b-159e-4589-a430-42266e796f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3a84f7b3-8d45-4d34-9060-efa1121ea8e1 tempest-ProjectReaderTests-603839290 None] Created volume successfully. Sep 01 02:17:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Acquiring lock "cinder-a24c38a7-a17b-447c-a363-b46a15b39b44-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Lock "cinder-a24c38a7-a17b-447c-a363-b46a15b39b44-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Acquiring lock "cinder-quobyte-a24c38a7-a17b-447c-a363-b46a15b39b44" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Lock "cinder-quobyte-a24c38a7-a17b-447c-a363-b46a15b39b44" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:52 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b9d5fa-d8c7-48b2-a41c-980674a0bcc9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:52 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44 Sep 01 02:17:52 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:52 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44" returned: 0 in 0.465s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:52 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44 Sep 01 02:17:52 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:53 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a24c38a7-a17b-447c-a363-b46a15b39b44" returned: 0 in 0.355s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Lock "cinder-quobyte-a24c38a7-a17b-447c-a363-b46a15b39b44" released by "delete_volume" :: held 0.872s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Created reservations ['a1a6d25e-9152-407b-ae9d-75ef847c567f', '6dfe9c6f-cfb6-4f01-a787-b8970c23be49', 'cd73067a-ffcb-4b0c-9f95-36c2a4f72e50', 'bb4caea1-0376-4eb0-88f3-e9e20391e040'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:53 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:53 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:53 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.318s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Deleted volume successfully. Sep 01 02:17:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b6f00401-a9f0-46b6-bcf6-bcbdfc650aa0 tempest-ProjectReaderTests-603839290 None] Lock "cinder-a24c38a7-a17b-447c-a363-b46a15b39b44-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Flow 'volume_create_manager' (16bf963c-9656-4637-bb6b-fc23925e0c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29159d96-1ab6-452f-97a1-8ab041749c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29159d96-1ab6-452f-97a1-8ab041749c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653146449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9affd507-48df-47f9-91d8-68e1e45604c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3297da3a5240b5b551abac08a8d0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:54Z,use_quota=True,user_id='16dade51efa4483e9768e5e7d5d34b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6765e9bd-65d0-4dd8-8285-304d62d1ea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6765e9bd-65d0-4dd8-8285-304d62d1ea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db2a894-f8fd-451e-8b34-9cc215b8d7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5db2a894-f8fd-451e-8b34-9cc215b8d7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9affd507-48df-47f9-91d8-68e1e45604c2', 'volume_name': 'volume-9affd507-48df-47f9-91d8-68e1e45604c2', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fce0ae8-b666-488e-b1a4-42d1bbc71071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fce0ae8-b666-488e-b1a4-42d1bbc71071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb38b36-cb94-478d-b91d-07b760e0fce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:54 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Volume 9affd507-48df-47f9-91d8-68e1e45604c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9affd507-48df-47f9-91d8-68e1e45604c2', 'volume_size': 1} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653146449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9affd507-48df-47f9-91d8-68e1e45604c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c3297da3a5240b5b551abac08a8d0a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:17:54Z,use_quota=True,user_id='16dade51efa4483e9768e5e7d5d34b8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Creating volume 9affd507-48df-47f9-91d8-68e1e45604c2 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:17:54 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:17:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:54 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2 1073741824 Sep 01 02:17:54 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:55 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2 1073741824" returned: 0 in 0.711s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:55 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2 Sep 01 02:17:55 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:55 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2" returned: 0 in 0.295s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:17:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb38b36-cb94-478d-b91d-07b760e0fce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9affd507-48df-47f9-91d8-68e1e45604c2', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6c8932-9fb4-4beb-abba-18858007ef7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:17:55 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Volume volume-9affd507-48df-47f9-91d8-68e1e45604c2 (9affd507-48df-47f9-91d8-68e1e45604c2): created successfully Sep 01 02:17:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b6c8932-9fb4-4beb-abba-18858007ef7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:17:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Flow 'volume_create_manager' (16bf963c-9656-4637-bb6b-fc23925e0c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:17:55 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-05ae944a-1208-4231-a28d-8533728aa718 tempest-ProjectReaderTests-603839290 None] Created volume successfully. Sep 01 02:17:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Acquiring lock "cinder-9affd507-48df-47f9-91d8-68e1e45604c2-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Lock "cinder-9affd507-48df-47f9-91d8-68e1e45604c2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Acquiring lock "cinder-quobyte-9affd507-48df-47f9-91d8-68e1e45604c2" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:17:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Lock "cinder-quobyte-9affd507-48df-47f9-91d8-68e1e45604c2" acquired by "delete_volume" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:17:56 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[743568de-a0e2-4841-8a73-f0ead8663d2b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:17:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:56 devstack sudo[102709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2 Sep 01 02:17:56 devstack sudo[102709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:56 devstack sudo[102709]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2" returned: 0 in 0.411s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:56 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2 Sep 01 02:17:56 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:57 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9affd507-48df-47f9-91d8-68e1e45604c2" returned: 0 in 0.321s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Lock "cinder-quobyte-9affd507-48df-47f9-91d8-68e1e45604c2" released by "delete_volume" :: held 0.785s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Created reservations ['8d3638e6-7bdd-42a7-9717-528a119f50d4', '04280090-eb8f-4c98-bc57-c967fe8b934e', '3e86cafa-ffe7-49e6-9cb5-e2a10ceb4969', '38346f20-dcc0-4657-aa9c-e14a350ff00e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:17:57 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:17:57 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:17:57 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.386s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:17:57 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Deleted volume successfully. Sep 01 02:17:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c68288d3-301f-4a85-98aa-366562bdb594 tempest-ProjectReaderTests-603839290 None] Lock "cinder-9affd507-48df-47f9-91d8-68e1e45604c2-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:07 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=36,cinder:INSERT=15,cinder:UPDATE=53,cinder:DELETE=4 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:07 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:INSERT=10,cinder:UPDATE=50,cinder:DELETE=4,cinder:SELECT=30 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:18:08 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Flow 'volume_create_manager' (dbd944dc-b015-4d0c-8dcf-ca76171e59ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94098b0-8159-4409-9ae4-96c97df5767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c94098b0-8159-4409-9ae4-96c97df5767c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1183096382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deaebd72-c5ea-40d9-823f-6953494a29d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0988482edef4d7fa9553307bb6c79f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:09Z,use_quota=True,user_id='e2baf5dd77684b338e5cfcc063363f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51c6cd7b-c2ab-484e-81dd-670c1cf79791),volume_type_id=51c6cd7b-c2ab-484e-81dd-670c1cf79791)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183e416e-09cf-4a87-8ead-83ce18274502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (183e416e-09cf-4a87-8ead-83ce18274502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57422574-d9d4-48d9-8fd3-bd25832c8826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57422574-d9d4-48d9-8fd3-bd25832c8826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'deaebd72-c5ea-40d9-823f-6953494a29d1', 'volume_name': 'volume-deaebd72-c5ea-40d9-823f-6953494a29d1', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0c5c5f-6eed-4b44-b238-173d0ef2a44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e0c5c5f-6eed-4b44-b238-173d0ef2a44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b433c906-0d35-4b01-a097-3005a717d2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:09 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Volume deaebd72-c5ea-40d9-823f-6953494a29d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-deaebd72-c5ea-40d9-823f-6953494a29d1', 'volume_size': 1} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1183096382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=deaebd72-c5ea-40d9-823f-6953494a29d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0988482edef4d7fa9553307bb6c79f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:09Z,use_quota=True,user_id='e2baf5dd77684b338e5cfcc063363f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51c6cd7b-c2ab-484e-81dd-670c1cf79791),volume_type_id=51c6cd7b-c2ab-484e-81dd-670c1cf79791)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Creating volume deaebd72-c5ea-40d9-823f-6953494a29d1 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:09 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:09 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1 1073741824 Sep 01 02:18:09 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Flow 'volume_create_manager' (bf48da6a-487a-4065-a011-1f65e5349fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab5a096-d7c1-488f-8f9f-283bda1a53db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab5a096-d7c1-488f-8f9f-283bda1a53db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1342572966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d15eb21-1cbd-40aa-bb0b-de17e3a582a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0988482edef4d7fa9553307bb6c79f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:09Z,use_quota=True,user_id='e2baf5dd77684b338e5cfcc063363f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2c0df4d-39b2-456d-a2e3-e3be3cc36bc5),volume_type_id=d2c0df4d-39b2-456d-a2e3-e3be3cc36bc5)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df7b173-e125-4898-a717-f96b5e0a3899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3df7b173-e125-4898-a717-f96b5e0a3899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8c33fc-d2d8-4e41-9bac-7e692441a767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8c33fc-d2d8-4e41-9bac-7e692441a767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d15eb21-1cbd-40aa-bb0b-de17e3a582a1', 'volume_name': 'volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97adbc4d-0d0f-4bcd-b139-0d280537cfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97adbc4d-0d0f-4bcd-b139-0d280537cfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12aa0e29-0691-436a-9acd-e0e61431e729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:09 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Volume 5d15eb21-1cbd-40aa-bb0b-de17e3a582a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1', 'volume_size': 1} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:09 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1 1073741824" returned: 0 in 0.778s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:09 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1 Sep 01 02:18:09 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:10 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1" returned: 0 in 0.397s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.515s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1342572966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d15eb21-1cbd-40aa-bb0b-de17e3a582a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0988482edef4d7fa9553307bb6c79f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:09Z,use_quota=True,user_id='e2baf5dd77684b338e5cfcc063363f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d2c0df4d-39b2-456d-a2e3-e3be3cc36bc5),volume_type_id=d2c0df4d-39b2-456d-a2e3-e3be3cc36bc5)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Creating volume 5d15eb21-1cbd-40aa-bb0b-de17e3a582a1 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:10 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b433c906-0d35-4b01-a097-3005a717d2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-deaebd72-c5ea-40d9-823f-6953494a29d1', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d6dc50-25a8-45fe-9bcc-4a7574a5f454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:10 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1 1073741824 Sep 01 02:18:10 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:10 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Volume volume-deaebd72-c5ea-40d9-823f-6953494a29d1 (deaebd72-c5ea-40d9-823f-6953494a29d1): created successfully Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d6dc50-25a8-45fe-9bcc-4a7574a5f454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Flow 'volume_create_manager' (dbd944dc-b015-4d0c-8dcf-ca76171e59ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:10 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a2637481-5762-4f65-8346-cb5202c2b240 tempest-TestInstancesWithCinderVolumes-306265532 None] Created volume successfully. Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Flow 'volume_create_manager' (f8707857-57f1-4733-beb5-c6abc1f1fb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d8a9be-c4a7-4693-bb36-1d3a22866926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9d8a9be-c4a7-4693-bb36-1d3a22866926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1105266884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0697b6-bc20-4a01-bf2c-1cf3165a63c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0988482edef4d7fa9553307bb6c79f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:10Z,use_quota=True,user_id='e2baf5dd77684b338e5cfcc063363f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57a50b32-66d1-4957-8320-d4dad894f124),volume_type_id=57a50b32-66d1-4957-8320-d4dad894f124)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a30c7f6-509c-47f3-9997-264e43c20442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a30c7f6-509c-47f3-9997-264e43c20442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1262e0ae-9d56-411d-9eac-42dedff17c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:10 devstack cinder-volume[87389]: DEBUG cinder.image.glance [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Creating Keystone auth plugin from conf {{(pid=87389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:18:11 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1 1073741824" returned: 0 in 0.825s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:11 devstack sudo[102740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1 Sep 01 02:18:11 devstack sudo[102740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1262e0ae-9d56-411d-9eac-42dedff17c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'df0697b6-bc20-4a01-bf2c-1cf3165a63c2', 'volume_name': 'volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2', 'volume_size': 1, 'image_id': '24b26514-cebf-406a-b3d0-045ebb84909d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b26514-cebf-406a-b3d0-045ebb84909d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--207008723', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0988482edef4d7fa9553307bb6c79f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b26514-cebf-406a-b3d0-045ebb84909d', 'created_at': datetime.datetime(2026, 9, 1, 0, 18, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 18, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b26514-cebf-406a-b3d0-045ebb84909d/file', 'properties': {}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f467ac-a3de-4837-86c9-dcdf01c08017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83f467ac-a3de-4837-86c9-dcdf01c08017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be172fd0-6d92-4bf5-966a-bf72e4783448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:11 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Volume df0697b6-bc20-4a01-bf2c-1cf3165a63c2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2', 'volume_size': 1, 'image_id': '24b26514-cebf-406a-b3d0-045ebb84909d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b26514-cebf-406a-b3d0-045ebb84909d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--207008723', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0988482edef4d7fa9553307bb6c79f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b26514-cebf-406a-b3d0-045ebb84909d', 'created_at': datetime.datetime(2026, 9, 1, 0, 18, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 18, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b26514-cebf-406a-b3d0-045ebb84909d/file', 'properties': {}}, 'image_service': } Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Trying to clone df0697b6-bc20-4a01-bf2c-1cf3165a63c2 from image 24b26514-cebf-406a-b3d0-045ebb84909d at location (None, [{'url': 'file:///opt/stack/data/glance/images/24b26514-cebf-406a-b3d0-045ebb84909d', 'metadata': {}}]). {{(pid=87389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:18:11 devstack sudo[102740]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1" returned: 0 in 0.404s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12aa0e29-0691-436a-9acd-e0e61431e729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e25c76-22b8-4934-9cc5-f6d56396476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:11 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Volume volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1 (5d15eb21-1cbd-40aa-bb0b-de17e3a582a1): created successfully Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e25c76-22b8-4934-9cc5-f6d56396476a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Flow 'volume_create_manager' (bf48da6a-487a-4065-a011-1f65e5349fde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:11 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c856d180-03ad-4ad0-b487-19967fc5b940 tempest-TestInstancesWithCinderVolumes-306265532 None] Created volume successfully. Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Flow 'volume_create_manager' (248ac4c5-2306-428b-b09b-77390fc1de38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c90315-72f5-4d90-ba39-567267add2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76c90315-72f5-4d90-ba39-567267add2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1835884201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a3365b-3db5-4a1a-a505-ecd3d8070677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb1d92033674d04b12e385597e22b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:15Z,use_quota=True,user_id='d94350a90c8645a6ab9dfbabefe22b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edece815-a72f-43e7-86a7-13483df1c44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edece815-a72f-43e7-86a7-13483df1c44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1355cebb-bb83-4a1d-b1cf-74a1cf0be6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1355cebb-bb83-4a1d-b1cf-74a1cf0be6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7a3365b-3db5-4a1a-a505-ecd3d8070677', 'volume_name': 'volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67105fd2-b7b8-4d91-97ad-137a3b085fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67105fd2-b7b8-4d91-97ad-137a3b085fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc2f7a1-2087-4b20-a035-b2e04c0d60a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:14 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Volume a7a3365b-3db5-4a1a-a505-ecd3d8070677: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677', 'volume_size': 1} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1835884201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7a3365b-3db5-4a1a-a505-ecd3d8070677,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb1d92033674d04b12e385597e22b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:15Z,use_quota=True,user_id='d94350a90c8645a6ab9dfbabefe22b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Creating volume a7a3365b-3db5-4a1a-a505-ecd3d8070677 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:14 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:14 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677 1073741824 Sep 01 02:18:14 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Flow 'volume_create_manager' (892dd86c-a60f-48b9-b59e-b29eeaa44566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ceb6701-a9dd-4e62-8167-0392e8f058c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ceb6701-a9dd-4e62-8167-0392e8f058c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-945256060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8feb2cf1-8f5b-486b-b790-a1c2235ee019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb1d92033674d04b12e385597e22b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:15Z,use_quota=True,user_id='d94350a90c8645a6ab9dfbabefe22b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc450c0-545f-4266-ab29-7da91c0f3151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc450c0-545f-4266-ab29-7da91c0f3151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972bf4aa-9066-4564-aeb7-5fea4db62859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (972bf4aa-9066-4564-aeb7-5fea4db62859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8feb2cf1-8f5b-486b-b790-a1c2235ee019', 'volume_name': 'volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3441f1f8-a4a4-4b6c-9bc0-21a0f9662c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3441f1f8-a4a4-4b6c-9bc0-21a0f9662c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a326310e-ec9c-4686-b94d-539bdbd8973e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:15 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Volume 8feb2cf1-8f5b-486b-b790-a1c2235ee019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019', 'volume_size': 1} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:15 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677 1073741824" returned: 0 in 0.813s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:15 devstack sudo[102756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677 Sep 01 02:18:15 devstack sudo[102756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Flow 'volume_create_manager' (e3824aaa-e3de-4038-8915-748c1a2a9874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5e0882-ce49-4626-bc81-7f3bb66aadfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5e0882-ce49-4626-bc81-7f3bb66aadfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-15602730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c429431-9594-4487-aa7c-affaa5ad859f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb1d92033674d04b12e385597e22b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:16Z,use_quota=True,user_id='d94350a90c8645a6ab9dfbabefe22b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aac7ced-1d0f-4008-ba2b-f5083840ddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aac7ced-1d0f-4008-ba2b-f5083840ddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3c3028-ed58-4a5a-b392-d8ad2e2b12b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e3c3028-ed58-4a5a-b392-d8ad2e2b12b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c429431-9594-4487-aa7c-affaa5ad859f', 'volume_name': 'volume-1c429431-9594-4487-aa7c-affaa5ad859f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70073e7-a250-4d9a-8922-20148d362039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f70073e7-a250-4d9a-8922-20148d362039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d4920d-1192-4696-8f62-d543583666a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:16 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Volume 1c429431-9594-4487-aa7c-affaa5ad859f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c429431-9594-4487-aa7c-affaa5ad859f', 'volume_size': 1} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:16 devstack sudo[102756]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677" returned: 0 in 0.424s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] <== create_volume: return (1308ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.681s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-945256060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8feb2cf1-8f5b-486b-b790-a1c2235ee019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb1d92033674d04b12e385597e22b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:15Z,use_quota=True,user_id='d94350a90c8645a6ab9dfbabefe22b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Creating volume 8feb2cf1-8f5b-486b-b790-a1c2235ee019 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:16 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc2f7a1-2087-4b20-a035-b2e04c0d60a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec03ef9-712d-49f6-aa10-57f0dd42f7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:16 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019 1073741824 Sep 01 02:18:16 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:16 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Volume volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677 (a7a3365b-3db5-4a1a-a505-ecd3d8070677): created successfully Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec03ef9-712d-49f6-aa10-57f0dd42f7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Flow 'volume_create_manager' (248ac4c5-2306-428b-b09b-77390fc1de38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:16 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2c0c99e8-3759-4d59-97fc-ff84f129a282 tempest-CreateVolumesFromImageTest-1093238459 None] Created volume successfully. Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Flow 'volume_create_manager' (4b9803b6-5a6c-41b5-a311-cd36be892606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2e0519-3b90-433f-85b5-52d9d5d4e7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2e0519-3b90-433f-85b5-52d9d5d4e7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18727459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901d175b-b8fe-4ccd-85b5-4d7929fd0304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb1d92033674d04b12e385597e22b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:16Z,use_quota=True,user_id='d94350a90c8645a6ab9dfbabefe22b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12b7e57-8421-4f70-b6cd-f6dc8a5d9b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c12b7e57-8421-4f70-b6cd-f6dc8a5d9b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6e1828-1ee9-4503-8ace-086b8ddc5f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6e1828-1ee9-4503-8ace-086b8ddc5f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '901d175b-b8fe-4ccd-85b5-4d7929fd0304', 'volume_name': 'volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eac3bf1-7f29-4dcf-aa4a-9202b8f293a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eac3bf1-7f29-4dcf-aa4a-9202b8f293a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2750d51c-92bf-44b0-a60a-0a69122637e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:16 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Volume 901d175b-b8fe-4ccd-85b5-4d7929fd0304: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304', 'volume_size': 1} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD, size 20.69 MB, duration 5.38 sec {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:18:16 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Image download 20.69 MB at 3.85 MB/s Sep 01 02:18:16 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019 1073741824" returned: 0 in 0.795s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e614f2-6d57-4ce3-a8d6-ad8a95a303f8]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:17 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019 Sep 01 02:18:17 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:17 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD Sep 01 02:18:17 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:17 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019" returned: 0 in 0.371s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.296s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-15602730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c429431-9594-4487-aa7c-affaa5ad859f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb1d92033674d04b12e385597e22b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:16Z,use_quota=True,user_id='d94350a90c8645a6ab9dfbabefe22b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Creating volume 1c429431-9594-4487-aa7c-affaa5ad859f {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:17 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a326310e-ec9c-4686-b94d-539bdbd8973e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5937f69-7629-437f-b93d-d2c07de1b769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:17 devstack sudo[102772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f 1073741824 Sep 01 02:18:17 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:17 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Volume volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019 (8feb2cf1-8f5b-486b-b790-a1c2235ee019): created successfully Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5937f69-7629-437f-b93d-d2c07de1b769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Flow 'volume_create_manager' (892dd86c-a60f-48b9-b59e-b29eeaa44566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Flow 'volume_create_manager' (613f73de-48a8-4895-a105-ab3922bf6dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a92cd3-909f-4a50-8dfc-41973f792b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:17 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:17 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-101ffbd7-2a6b-4ae4-a7e5-c9ab6a4f1372 tempest-CreateVolumesFromImageTest-1093238459 None] Created volume successfully. Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD" returned: 0 in 0.585s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Temporary image 24b26514-cebf-406a-b3d0-045ebb84909d is fetched for user e2baf5dd77684b338e5cfcc063363f54. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a92cd3-909f-4a50-8dfc-41973f792b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034093079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f475efc-13e3-4154-867b-a809d0723a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb1d92033674d04b12e385597e22b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:17Z,use_quota=True,user_id='d94350a90c8645a6ab9dfbabefe22b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ea6e92-fd97-4c99-aa20-ac05b3f59bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ea6e92-fd97-4c99-aa20-ac05b3f59bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3d3e77-42e8-4525-9a6d-51a8f6e361d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3d3e77-42e8-4525-9a6d-51a8f6e361d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f475efc-13e3-4154-867b-a809d0723a2f', 'volume_name': 'volume-3f475efc-13e3-4154-867b-a809d0723a2f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51982895-fca0-48ff-9c1b-025bd55595c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51982895-fca0-48ff-9c1b-025bd55595c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6ba8b7-37ee-4ed8-bdd7-5b9a53cb38ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:17 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Volume 3f475efc-13e3-4154-867b-a809d0723a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f475efc-13e3-4154-867b-a809d0723a2f', 'volume_size': 1} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cd6bb0-9f3f-486b-ac5b-621b955fbecc]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:17 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD Sep 01 02:18:17 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:18 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f 1073741824" returned: 0 in 0.771s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:18 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:18 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f Sep 01 02:18:18 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:18 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f" returned: 0 in 0.279s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.874s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18727459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901d175b-b8fe-4ccd-85b5-4d7929fd0304,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb1d92033674d04b12e385597e22b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:16Z,use_quota=True,user_id='d94350a90c8645a6ab9dfbabefe22b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Creating volume 901d175b-b8fe-4ccd-85b5-4d7929fd0304 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:18 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d4920d-1192-4696-8f62-d543583666a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c429431-9594-4487-aa7c-affaa5ad859f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a49883-1c3a-4aa8-b059-b1e1b1b0f40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:18 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304 1073741824 Sep 01 02:18:18 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:18 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Volume volume-1c429431-9594-4487-aa7c-affaa5ad859f (1c429431-9594-4487-aa7c-affaa5ad859f): created successfully Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51a49883-1c3a-4aa8-b059-b1e1b1b0f40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Flow 'volume_create_manager' (e3824aaa-e3de-4038-8915-748c1a2a9874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:18 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-28f15665-6cec-404a-b356-5b736b9f9250 tempest-CreateVolumesFromImageTest-1093238459 None] Created volume successfully. Sep 01 02:18:18 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304 1073741824" returned: 0 in 0.493s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:19 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304 Sep 01 02:18:19 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:19 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304" returned: 0 in 0.252s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.619s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2034093079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f475efc-13e3-4154-867b-a809d0723a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdb1d92033674d04b12e385597e22b08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:17Z,use_quota=True,user_id='d94350a90c8645a6ab9dfbabefe22b7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Creating volume 3f475efc-13e3-4154-867b-a809d0723a2f {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:19 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2750d51c-92bf-44b0-a60a-0a69122637e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37b5543-e412-4155-8bff-39e66aa8a424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:19 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f 1073741824 Sep 01 02:18:19 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:19 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Volume volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304 (901d175b-b8fe-4ccd-85b5-4d7929fd0304): created successfully Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c37b5543-e412-4155-8bff-39e66aa8a424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Flow 'volume_create_manager' (4b9803b6-5a6c-41b5-a311-cd36be892606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ee325bf2-7300-47f9-8150-b4e6950c51a8 tempest-CreateVolumesFromImageTest-1093238459 None] Created volume successfully. Sep 01 02:18:19 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f 1073741824" returned: 0 in 0.577s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:19 devstack sudo[102806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f Sep 01 02:18:19 devstack sudo[102806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:20 devstack sudo[102806]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f" returned: 0 in 0.284s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.037s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1105266884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df0697b6-bc20-4a01-bf2c-1cf3165a63c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0988482edef4d7fa9553307bb6c79f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:10Z,use_quota=True,user_id='e2baf5dd77684b338e5cfcc063363f54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(57a50b32-66d1-4957-8320-d4dad894f124),volume_type_id=57a50b32-66d1-4957-8320-d4dad894f124)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Creating volume df0697b6-bc20-4a01-bf2c-1cf3165a63c2 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:20 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6ba8b7-37ee-4ed8-bdd7-5b9a53cb38ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f475efc-13e3-4154-867b-a809d0723a2f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4103d172-90fc-4e3e-8da0-e23d3511370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:20 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 1073741824 Sep 01 02:18:20 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:20 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Volume volume-3f475efc-13e3-4154-867b-a809d0723a2f (3f475efc-13e3-4154-867b-a809d0723a2f): created successfully Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4103d172-90fc-4e3e-8da0-e23d3511370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Flow 'volume_create_manager' (613f73de-48a8-4895-a105-ab3922bf6dcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a36bec73-7f8b-4770-90c7-179e9db6bfa8 tempest-CreateVolumesFromImageTest-1093238459 None] Created volume successfully. Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "cinder-3f475efc-13e3-4154-867b-a809d0723a2f-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-3f475efc-13e3-4154-867b-a809d0723a2f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "cinder-quobyte-3f475efc-13e3-4154-867b-a809d0723a2f" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:20 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-quobyte-3f475efc-13e3-4154-867b-a809d0723a2f" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 1073741824" returned: 0 in 0.635s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[15477dda-8fad-402a-a609-8366294ad80d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:20 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 Sep 01 02:18:20 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:21 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f Sep 01 02:18:21 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:21 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2" returned: 0 in 0.340s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Attempting download of 24b26514-cebf-406a-b3d0-045ebb84909d ((None, [{'url': 'file:///opt/stack/data/glance/images/24b26514-cebf-406a-b3d0-045ebb84909d', 'metadata': {}}])) to volume df0697b6-bc20-4a01-bf2c-1cf3165a63c2. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:18:21 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f" returned: 0 in 0.475s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bd8550-86ec-40c7-8450-be23e933fb21]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b26514-cebf-406a-b3d0-045ebb84909d_7qztl2bp {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:21 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f Sep 01 02:18:21 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:21 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b26514-cebf-406a-b3d0-045ebb84909d_7qztl2bp Sep 01 02:18:21 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:21 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3f475efc-13e3-4154-867b-a809d0723a2f" returned: 0 in 0.261s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-quobyte-3f475efc-13e3-4154-867b-a809d0723a2f" released by "delete_volume" :: held 0.781s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Created reservations ['15e06877-4766-4f69-a6d9-1ec5d7359c99', '280adb4b-800d-4f1a-8b8c-89479f2b20fa', 'e02ff12b-236f-4450-8c01-a244e09103d8', '7260b35b-2504-4ab0-b380-127fdb8953f0'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:21 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24b26514-cebf-406a-b3d0-045ebb84909d_7qztl2bp" returned: 0 in 0.366s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b26514-cebf-406a-b3d0-045ebb84909d_7qztl2bp {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:21 devstack sudo[102831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:18:21 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:21 devstack sudo[102830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b26514-cebf-406a-b3d0-045ebb84909d_7qztl2bp Sep 01 02:18:21 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "cinder-901d175b-b8fe-4ccd-85b5-4d7929fd0304-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-901d175b-b8fe-4ccd-85b5-4d7929fd0304-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "cinder-quobyte-901d175b-b8fe-4ccd-85b5-4d7929fd0304" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-quobyte-901d175b-b8fe-4ccd-85b5-4d7929fd0304" acquired by "delete_volume" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99294f1-8ea6-40c7-9c2b-8520022139b1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:22 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.312s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:22 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Deleted volume successfully. Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0d632f8d-9ddd-4937-80a0-883b8d189127 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-3f475efc-13e3-4154-867b-a809d0723a2f-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:22 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b26514-cebf-406a-b3d0-045ebb84909d_7qztl2bp" returned: 1 in 0.474s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24b26514-cebf-406a-b3d0-045ebb84909d_7qztl2bp' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ba2a5e-b03a-4712-a708-d963bf65ef72]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:22 devstack sudo[102835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304 Sep 01 02:18:22 devstack sudo[102835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:22 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD Sep 01 02:18:22 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:22 devstack sudo[102835]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304" returned: 0 in 0.418s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:22 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304 Sep 01 02:18:22 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:22 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] 24b26514-cebf-406a-b3d0-045ebb84909d was qcow2, converting to qcow2 {{(pid=87389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:22 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 Sep 01 02:18:22 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:22 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-901d175b-b8fe-4ccd-85b5-4d7929fd0304" returned: 0 in 0.261s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-quobyte-901d175b-b8fe-4ccd-85b5-4d7929fd0304" released by "delete_volume" :: held 0.730s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Created reservations ['62fcae22-3552-4e6b-80bf-faaa3f97102b', 'dfce7de9-b125-40d4-910d-f424499ccad1', 'dd5bc2fa-eb33-4645-91a2-8fd2ca339664', '7dc45ffb-649d-48c0-a52d-a1a0e05beb61'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:23 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:18:23 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "cinder-1c429431-9594-4487-aa7c-affaa5ad859f-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-1c429431-9594-4487-aa7c-affaa5ad859f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "cinder-quobyte-1c429431-9594-4487-aa7c-affaa5ad859f" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-quobyte-1c429431-9594-4487-aa7c-affaa5ad859f" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:23 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.345s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:23 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:23 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d2332c-1a6a-4eb4-9389-f53330890f31]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:23 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Deleted volume successfully. Sep 01 02:18:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1984f4f3-9a74-46d8-8ea7-6f097e4d8907 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-901d175b-b8fe-4ccd-85b5-4d7929fd0304-delete_volume" released by "delete_volume" :: held 1.362s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:23 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f Sep 01 02:18:23 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:23 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f" returned: 0 in 0.453s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:23 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f Sep 01 02:18:23 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:24 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c429431-9594-4487-aa7c-affaa5ad859f" returned: 0 in 0.302s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-quobyte-1c429431-9594-4487-aa7c-affaa5ad859f" released by "delete_volume" :: held 0.818s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Created reservations ['fbf7985c-9e15-4cf3-8ec4-6e21d38f09b1', 'e805d7ef-8efc-4a87-9bb7-56497f239191', '41e8b02f-7644-4ec4-89fa-c436bc7b5b8e', '6ebb4b4a-d1f0-415e-93c6-011aeb37ba2d'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:24 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:18:24 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "cinder-8feb2cf1-8f5b-486b-b790-a1c2235ee019-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-8feb2cf1-8f5b-486b-b790-a1c2235ee019-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "cinder-quobyte-8feb2cf1-8f5b-486b-b790-a1c2235ee019" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-quobyte-8feb2cf1-8f5b-486b-b790-a1c2235ee019" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d43a8d-e5e6-4ed9-bb93-6e3504a37e42]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:24 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.379s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:24 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019 Sep 01 02:18:24 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:24 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Deleted volume successfully. Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-311d75be-4d0f-4277-82fa-99334a938c56 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-1c429431-9594-4487-aa7c-affaa5ad859f-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:24 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2" returned: 0 in 2.248s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24b26514-cebf-406a-b3d0-045ebb84909d_t1igyrs1devstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:18:24 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Converted 112.00 MB image at 49.80 MB/s Sep 01 02:18:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:24 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 1G Sep 01 02:18:24 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:25 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019" returned: 0 in 0.430s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:25 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019 Sep 01 02:18:25 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:25 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 1G" returned: 0 in 0.381s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Downloaded image 24b26514-cebf-406a-b3d0-045ebb84909d ((None, [{'url': 'file:///opt/stack/data/glance/images/24b26514-cebf-406a-b3d0-045ebb84909d', 'metadata': {}}])) to volume df0697b6-bc20-4a01-bf2c-1cf3165a63c2 successfully. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Temporary image 24b26514-cebf-406a-b3d0-045ebb84909d for user e2baf5dd77684b338e5cfcc063363f54 is deleted. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Marking volume df0697b6-bc20-4a01-bf2c-1cf3165a63c2 as bootable. {{(pid=87389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Copying metadata from image 24b26514-cebf-406a-b3d0-045ebb84909d to df0697b6-bc20-4a01-bf2c-1cf3165a63c2. {{(pid=87389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Creating volume glance metadata for volume df0697b6-bc20-4a01-bf2c-1cf3165a63c2 backed by image 24b26514-cebf-406a-b3d0-045ebb84909d with: {'image_id': '24b26514-cebf-406a-b3d0-045ebb84909d', 'image_name': 'tempest-scenario-img--207008723', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:18:25 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8feb2cf1-8f5b-486b-b790-a1c2235ee019" returned: 0 in 0.293s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-quobyte-8feb2cf1-8f5b-486b-b790-a1c2235ee019" released by "delete_volume" :: held 0.778s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be172fd0-6d92-4bf5-966a-bf72e4783448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2', 'volume_size': 1, 'image_id': '24b26514-cebf-406a-b3d0-045ebb84909d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24b26514-cebf-406a-b3d0-045ebb84909d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--207008723', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b0988482edef4d7fa9553307bb6c79f0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '24b26514-cebf-406a-b3d0-045ebb84909d', 'created_at': datetime.datetime(2026, 9, 1, 0, 18, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 18, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24b26514-cebf-406a-b3d0-045ebb84909d/file', 'properties': {}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df4ef62-1f0d-4c3b-999b-5193933206c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:25 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Volume volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 (df0697b6-bc20-4a01-bf2c-1cf3165a63c2): created successfully Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df4ef62-1f0d-4c3b-999b-5193933206c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Flow 'volume_create_manager' (f8707857-57f1-4733-beb5-c6abc1f1fb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1bd3a985-3c6f-49bd-8a5a-529ac379b866 tempest-TestInstancesWithCinderVolumes-306265532 None] Created volume successfully. Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Created reservations ['d7137188-0cfa-4d31-86e1-409841009c19', '527a842c-cb3e-4224-9c56-379b600bb494', '0b12935a-622f-4bdf-b08a-33b8f367c796', '51eab6db-b6d0-4219-b29a-3becb974ec11'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:25 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:18:25 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "cinder-a7a3365b-3db5-4a1a-a505-ecd3d8070677-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-a7a3365b-3db5-4a1a-a505-ecd3d8070677-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "cinder-quobyte-a7a3365b-3db5-4a1a-a505-ecd3d8070677" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-quobyte-a7a3365b-3db5-4a1a-a505-ecd3d8070677" acquired by "delete_volume" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:25 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.335s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Deleted volume successfully. Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[de94e159-b14e-4445-813e-dd31c7bab5ab]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-23f08478-120c-4d55-a58e-3494e09aa3e0 tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-8feb2cf1-8f5b-486b-b790-a1c2235ee019-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:25 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677 Sep 01 02:18:25 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:26 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677" returned: 0 in 0.449s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:26 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677 Sep 01 02:18:26 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:26 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a7a3365b-3db5-4a1a-a505-ecd3d8070677" returned: 0 in 0.431s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:26 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-quobyte-a7a3365b-3db5-4a1a-a505-ecd3d8070677" released by "delete_volume" :: held 0.947s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:26 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Created reservations ['33dba4c4-121e-475c-8c0b-8e52e8fc7cf4', 'a0142d9a-1a4e-4cca-a879-3d3a7228876d', 'f052a3e8-1a68-4a49-bb06-514c07402aef', '356ae705-69ce-45bf-b188-1667a9442c99'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:26 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:18:26 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:27 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.284s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:27 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:27 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Deleted volume successfully. Sep 01 02:18:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f028c0ce-59e7-4258-b94d-04bf2ab5434f tempest-CreateVolumesFromImageTest-1093238459 None] Lock "cinder-a7a3365b-3db5-4a1a-a505-ecd3d8070677-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-9c7c5824-6d4a-4c05-8959-cac98ec684d3 req-63749190-eb29-4bbd-806c-37d336e7dc52 tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-9c7c5824-6d4a-4c05-8959-cac98ec684d3 req-63749190-eb29-4bbd-806c-37d336e7dc52 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-9c7c5824-6d4a-4c05-8959-cac98ec684d3 req-63749190-eb29-4bbd-806c-37d336e7dc52 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:29 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-9c7c5824-6d4a-4c05-8959-cac98ec684d3 req-63749190-eb29-4bbd-806c-37d336e7dc52 tempest-TestInstancesWithCinderVolumes-306265532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '613d89ec-0593-4222-b3d4-d876c1ccc54c', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:18:29 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-9c7c5824-6d4a-4c05-8959-cac98ec684d3 req-63749190-eb29-4bbd-806c-37d336e7dc52 tempest-TestInstancesWithCinderVolumes-306265532 None] attachment_update completed successfully. Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Flow 'volume_create_manager' (7c821e19-943d-42c8-ad55-2c2ca69b53ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df4e7ea-17e6-41c3-bd7f-5d74942b24ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df4e7ea-17e6-41c3-bd7f-5d74942b24ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a248b2c3-d92a-414d-8f95-0d16254160f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a8684aeec849eeaea13449961c1aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:32Z,use_quota=True,user_id='d8148e366036444c93b4c90c2ec887ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3ccc77-5435-4d91-8e39-9363f79347ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3ccc77-5435-4d91-8e39-9363f79347ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e39b81-0e8c-4437-a9bb-23ce42616bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e39b81-0e8c-4437-a9bb-23ce42616bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a248b2c3-d92a-414d-8f95-0d16254160f6', 'volume_name': 'volume-a248b2c3-d92a-414d-8f95-0d16254160f6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0320177a-a67e-4b3c-90ea-0afb324bd03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0320177a-a67e-4b3c-90ea-0afb324bd03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d049ea-1d60-4f2b-ae2e-bb8968bade45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:32 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Volume a248b2c3-d92a-414d-8f95-0d16254160f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a248b2c3-d92a-414d-8f95-0d16254160f6', 'volume_size': 1} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a248b2c3-d92a-414d-8f95-0d16254160f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a8684aeec849eeaea13449961c1aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:32Z,use_quota=True,user_id='d8148e366036444c93b4c90c2ec887ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Creating volume a248b2c3-d92a-414d-8f95-0d16254160f6 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:32 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:32 devstack sudo[102949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6 1073741824 Sep 01 02:18:32 devstack sudo[102949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:33 devstack sudo[102949]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6 1073741824" returned: 0 in 0.588s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:33 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6 Sep 01 02:18:33 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:33 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6" returned: 0 in 0.435s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38d049ea-1d60-4f2b-ae2e-bb8968bade45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a248b2c3-d92a-414d-8f95-0d16254160f6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c410ace-beca-4e99-b1e9-409b19d9bd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:33 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Volume volume-a248b2c3-d92a-414d-8f95-0d16254160f6 (a248b2c3-d92a-414d-8f95-0d16254160f6): created successfully Sep 01 02:18:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c410ace-beca-4e99-b1e9-409b19d9bd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Flow 'volume_create_manager' (7c821e19-943d-42c8-ad55-2c2ca69b53ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:33 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3f9e49d4-ab38-49f2-8947-edc00771f559 tempest-CinderUnicodeTest-582883069 None] Created volume successfully. Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Flow 'volume_create_manager' (58175763-e1a2-4866-9385-c9c3a7474813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7245bf-9e94-4a43-8546-91cde626cdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af7245bf-9e94-4a43-8546-91cde626cdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1393958544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5c76a1fabb4994bc1d7e73cb71f335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:35Z,use_quota=True,user_id='3d59875bfa414b808c863302d8d8d67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e1406c-1359-461f-a3b7-24908d5e35fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21e1406c-1359-461f-a3b7-24908d5e35fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaac1696-f162-40d1-a5c3-8bc31d1cb164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaac1696-f162-40d1-a5c3-8bc31d1cb164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae', 'volume_name': 'volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84450bb-545f-4b9a-9ce7-f1287025ba29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e84450bb-545f-4b9a-9ce7-f1287025ba29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06f41ba-07d0-4d8c-832a-4e12e3e91af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:35 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Volume a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae', 'volume_size': 1} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1393958544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5c76a1fabb4994bc1d7e73cb71f335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:35Z,use_quota=True,user_id='3d59875bfa414b808c863302d8d8d67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Creating volume a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:35 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:35 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae 1073741824 Sep 01 02:18:35 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Flow 'volume_create_manager' (aef08486-20b6-46b2-adcb-b3c53098bc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2496c1c-c8c1-4d00-997f-fa2c0f690396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2496c1c-c8c1-4d00-997f-fa2c0f690396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1777283885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83689f37-6101-463e-b86e-ca827f40bb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a8684aeec849eeaea13449961c1aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:36Z,use_quota=True,user_id='d8148e366036444c93b4c90c2ec887ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e0cefa-5ae8-4a8a-bdd6-8030e2413513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0e0cefa-5ae8-4a8a-bdd6-8030e2413513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6741172f-de59-4e2a-a48b-18e0f581b9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6741172f-de59-4e2a-a48b-18e0f581b9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83689f37-6101-463e-b86e-ca827f40bb6c', 'volume_name': 'volume-83689f37-6101-463e-b86e-ca827f40bb6c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355b1602-0700-4a6e-a896-227368a7b1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355b1602-0700-4a6e-a896-227368a7b1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dae26d9-8778-4519-b5dd-b19ea5f571e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:36 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Volume 83689f37-6101-463e-b86e-ca827f40bb6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83689f37-6101-463e-b86e-ca827f40bb6c', 'volume_size': 1} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:36 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae 1073741824" returned: 0 in 0.751s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:36 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae Sep 01 02:18:36 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:36 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" returned: 0 in 0.398s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1777283885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83689f37-6101-463e-b86e-ca827f40bb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8a8684aeec849eeaea13449961c1aeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:36Z,use_quota=True,user_id='d8148e366036444c93b4c90c2ec887ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Creating volume 83689f37-6101-463e-b86e-ca827f40bb6c {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:36 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06f41ba-07d0-4d8c-832a-4e12e3e91af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353f470b-62a7-42f0-8939-a960c4ad2aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:36 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c 1073741824 Sep 01 02:18:36 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:36 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Volume volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae (a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae): created successfully Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353f470b-62a7-42f0-8939-a960c4ad2aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:36 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Flow 'volume_create_manager' (58175763-e1a2-4866-9385-c9c3a7474813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:36 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-36e224ad-449d-4dee-ae53-2d803ec6b567 tempest-SnapshotDependencyTests-1952083615 None] Created volume successfully. Sep 01 02:18:37 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c 1073741824" returned: 0 in 0.736s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:37 devstack sudo[103421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c Sep 01 02:18:37 devstack sudo[103421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:37 devstack sudo[103421]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c" returned: 0 in 0.393s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.195s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.230s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] Creating offline snapshot 526d2760-6869-41ec-8576-4f8a4e60e7f6 of volume a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dae26d9-8778-4519-b5dd-b19ea5f571e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83689f37-6101-463e-b86e-ca827f40bb6c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910c9ebe-45ec-4ab4-a0aa-7175505722d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[27061e94-16f6-4d1b-80ee-c08f397456c3]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:38 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Volume volume-83689f37-6101-463e-b86e-ca827f40bb6c (83689f37-6101-463e-b86e-ca827f40bb6c): created successfully Sep 01 02:18:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910c9ebe-45ec-4ab4-a0aa-7175505722d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Flow 'volume_create_manager' (aef08486-20b6-46b2-adcb-b3c53098bc4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:38 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-324bad06-ebf9-4898-a948-d2b6ecaacdbb tempest-CinderUnicodeTest-582883069 None] Created volume successfully. Sep 01 02:18:38 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae Sep 01 02:18:38 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:38 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" returned: 0 in 0.715s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:38 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 1G Sep 01 02:18:38 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:39 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 1G" returned: 0 in 0.636s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:39 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 Sep 01 02:18:39 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:39 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6" returned: 0 in 0.382s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:39 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 is being set with open permissions: ugo+rw Sep 01 02:18:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:39 devstack sudo[103440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 Sep 01 02:18:39 devstack sudo[103440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:40 devstack sudo[103440]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6" returned: 0 in 0.383s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:40 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.info Sep 01 02:18:40 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:40 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.info" returned: 0 in 0.326s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:40 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.info is being set with open permissions: ugo+rw Sep 01 02:18:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:40 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.info Sep 01 02:18:40 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:40 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.info" returned: 0 in 0.440s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.042s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] Creating offline snapshot 5bfc98c7-9a05-4416-9877-408b32478ee3 of volume 83689f37-6101-463e-b86e-ca827f40bb6c {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:18:41 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaa410a-3a9d-4772-a6cd-ccb758d182e6]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f101d1e3-2b38-4566-ba67-adbf8b3d9830 tempest-SnapshotDependencyTests-1952083615 None] Create snapshot completed successfully Sep 01 02:18:41 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c Sep 01 02:18:41 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:41 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c" returned: 0 in 0.697s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:41 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 1G Sep 01 02:18:41 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:42 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 1G" returned: 0 in 0.715s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83689f37-6101-463e-b86e-ca827f40bb6c -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:42 devstack sudo[103461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83689f37-6101-463e-b86e-ca827f40bb6c -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 Sep 01 02:18:42 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:42 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83689f37-6101-463e-b86e-ca827f40bb6c -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3" returned: 0 in 0.495s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:42 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 is being set with open permissions: ugo+rw Sep 01 02:18:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:42 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 Sep 01 02:18:42 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Flow 'volume_create_manager' (24362384-5458-4ea7-a4ce-0b6e659172fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0cd2af-ee14-4dd4-8fe9-911a3e502202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b0cd2af-ee14-4dd4-8fe9-911a3e502202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da6a138-424e-4468-a33f-af3361f4979b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5c76a1fabb4994bc1d7e73cb71f335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=526d2760-6869-41ec-8576-4f8a4e60e7f6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:43Z,use_quota=True,user_id='3d59875bfa414b808c863302d8d8d67c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e377203-eb9d-4837-acb7-d0b967f42b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e377203-eb9d-4837-acb7-d0b967f42b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776f5ec0-745b-453a-9584-136ab886347b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776f5ec0-745b-453a-9584-136ab886347b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1da6a138-424e-4468-a33f-af3361f4979b', 'volume_name': 'volume-1da6a138-424e-4468-a33f-af3361f4979b', 'volume_size': 1, 'snapshot_id': '526d2760-6869-41ec-8576-4f8a4e60e7f6'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990a9e58-d8c6-4c60-84f7-43ec14ec2ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (990a9e58-d8c6-4c60-84f7-43ec14ec2ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d0850b-6213-402c-a9ff-b8e580edf965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:43 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Volume 1da6a138-424e-4468-a33f-af3361f4979b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1da6a138-424e-4468-a33f-af3361f4979b', 'volume_size': 1, 'snapshot_id': '526d2760-6869-41ec-8576-4f8a4e60e7f6'} Sep 01 02:18:43 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3" returned: 0 in 0.400s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:43 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.info Sep 01 02:18:43 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:43 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.info" returned: 0 in 0.305s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:43 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.info is being set with open permissions: ugo+rw Sep 01 02:18:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:43 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.info Sep 01 02:18:43 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:44 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.info" returned: 0 in 0.327s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.073s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.709s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "cinder-quobyte-526d2760-6869-41ec-8576-4f8a4e60e7f6-1da6a138-424e-4468-a33f-af3361f4979b" by "_create_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-526d2760-6869-41ec-8576-4f8a4e60e7f6-1da6a138-424e-4468-a33f-af3361f4979b" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Creating volume 1da6a138-424e-4468-a33f-af3361f4979b from snapshot 526d2760-6869-41ec-8576-4f8a4e60e7f6 {{(pid=87389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "cinder-quobyte-1da6a138-424e-4468-a33f-af3361f4979b" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:44 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b9a22b58-8811-482f-8c7a-b315537858ec tempest-CinderUnicodeTest-582883069 None] Create snapshot completed successfully Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-1da6a138-424e-4468-a33f-af3361f4979b" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] snapshot: 526d2760-6869-41ec-8576-4f8a4e60e7f6, volume: 1da6a138-424e-4468-a33f-af3361f4979b, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aebc2d8-70c1-4f3a-972b-d2c153f572c4]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:44 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 Sep 01 02:18:44 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Acquiring lock "cinder-5bfc98c7-9a05-4416-9877-408b32478ee3-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-5bfc98c7-9a05-4416-9877-408b32478ee3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Acquiring lock "cinder-quobyte-83689f37-6101-463e-b86e-ca827f40bb6c" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-quobyte-83689f37-6101-463e-b86e-ca827f40bb6c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Acquiring lock "cinder-quobyte-5bfc98c7-9a05-4416-9877-408b32478ee3" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-quobyte-5bfc98c7-9a05-4416-9877-408b32478ee3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Deleting offline snapshot 5bfc98c7-9a05-4416-9877-408b32478ee3 of volume 83689f37-6101-463e-b86e-ca827f40bb6c {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] snapshot_file for this snap is: volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[034893c4-291a-45e9-bbdc-25c72a92268c]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:44 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 Sep 01 02:18:44 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:44 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6" returned: 0 in 0.583s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[11fa4782-8f55-4dce-80d8-b531bf59bb02]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:44 devstack sudo[103485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae Sep 01 02:18:44 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:44 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3" returned: 0 in 0.457s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83689f37-6101-463e-b86e-ca827f40bb6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:45 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf266278-8c3b-49cf-bacc-eb908a106aeb]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:45 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" returned: 0 in 0.485s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:18:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:18:45 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:18:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:45 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c Sep 01 02:18:45 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:45 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b Sep 01 02:18:45 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:45 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c" returned: 0 in 0.613s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:45 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 Sep 01 02:18:45 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:46 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3" returned: 0 in 0.959s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:46 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3 Sep 01 02:18:46 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:18:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:47 devstack sudo[103521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:18:47 devstack sudo[103521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:47 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c.5bfc98c7-9a05-4416-9877-408b32478ee3" returned: 0 in 1.214s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-quobyte-5bfc98c7-9a05-4416-9877-408b32478ee3" released by "_delete_snapshot" :: held 3.501s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-quobyte-83689f37-6101-463e-b86e-ca827f40bb6c" released by "delete_snapshot" :: held 3.579s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:48 devstack sudo[103521]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 1.157s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:48 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:48 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Created reservations ['4649a644-6181-4265-8096-85fa2941beee', '6fa43e19-74d9-4f1e-a8d7-1622a45ed05b', '44356ae8-e3e9-4ca7-a2cc-32883e2c4140', '1b4abb12-b47e-4ccd-8d83-472141374d65'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:48 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:18:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:18:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:18:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Delete snapshot completed successfully. Sep 01 02:18:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-eca765f2-1685-4952-83c0-8eeb56dc7779 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-5bfc98c7-9a05-4416-9877-408b32478ee3-delete_snapshot" released by "delete_snapshot" :: held 4.267s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Acquiring lock "cinder-83689f37-6101-463e-b86e-ca827f40bb6c-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-83689f37-6101-463e-b86e-ca827f40bb6c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Acquiring lock "cinder-quobyte-83689f37-6101-463e-b86e-ca827f40bb6c" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-quobyte-83689f37-6101-463e-b86e-ca827f40bb6c" acquired by "delete_volume" :: waited 0.061s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:49 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6821cc37-a60d-47a7-bdcb-46483efbc971]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:49 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c Sep 01 02:18:49 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:50 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c" returned: 0 in 1.067s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:50 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c Sep 01 02:18:50 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:51 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-83689f37-6101-463e-b86e-ca827f40bb6c" returned: 0 in 0.773s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-quobyte-83689f37-6101-463e-b86e-ca827f40bb6c" released by "delete_volume" :: held 2.055s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:51 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Created reservations ['c35a9af6-f9d9-435b-9ce0-861dc5555ded', 'a514dd42-f886-4861-b915-539626c92bdf', 'ae793a79-b77c-4e15-b8df-96b2cdf54c9b', 'd37e8c34-7064-4eb7-ad93-9a0567717a71'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:52 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:18:52 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:52 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.795s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:52 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:52 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Deleted volume successfully. Sep 01 02:18:52 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b" returned: 0 in 7.441s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:52 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:18:52 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Converted 1024.00 MB image at 137.59 MB/s Sep 01 02:18:52 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b is being set with open permissions: ugo+rw Sep 01 02:18:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-91e6a058-c037-4890-8e5e-d8be1d331117 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-83689f37-6101-463e-b86e-ca827f40bb6c-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:52 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b Sep 01 02:18:52 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Acquiring lock "cinder-a248b2c3-d92a-414d-8f95-0d16254160f6-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-a248b2c3-d92a-414d-8f95-0d16254160f6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Acquiring lock "cinder-quobyte-a248b2c3-d92a-414d-8f95-0d16254160f6" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-quobyte-a248b2c3-d92a-414d-8f95-0d16254160f6" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:53 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c908589a-7e36-448c-ab71-58b117dc3d78]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b" returned: 0 in 0.367s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-1da6a138-424e-4468-a33f-af3361f4979b" released by "_copy_volume_from_snapshot" :: held 8.981s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-526d2760-6869-41ec-8576-4f8a4e60e7f6-1da6a138-424e-4468-a33f-af3361f4979b" released by "_create_volume_from_snapshot" :: held 9.092s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.132s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18d0850b-6213-402c-a9ff-b8e580edf965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1da6a138-424e-4468-a33f-af3361f4979b', 'volume_size': 1, 'snapshot_id': '526d2760-6869-41ec-8576-4f8a4e60e7f6'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bcff486-8334-4561-8d6d-f106c1b073b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:53 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Volume volume-1da6a138-424e-4468-a33f-af3361f4979b (1da6a138-424e-4468-a33f-af3361f4979b): created successfully Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bcff486-8334-4561-8d6d-f106c1b073b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Flow 'volume_create_manager' (24362384-5458-4ea7-a4ce-0b6e659172fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:53 devstack sudo[103543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6 Sep 01 02:18:53 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-35d5c7a7-7c11-42be-adfa-2a229c20e63a tempest-SnapshotDependencyTests-1952083615 None] Created volume successfully. Sep 01 02:18:53 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6" returned: 0 in 0.514s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:53 devstack sudo[103548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6 Sep 01 02:18:53 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:53 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a248b2c3-d92a-414d-8f95-0d16254160f6" returned: 0 in 0.360s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-quobyte-a248b2c3-d92a-414d-8f95-0d16254160f6" released by "delete_volume" :: held 0.929s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "cinder-526d2760-6869-41ec-8576-4f8a4e60e7f6-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-526d2760-6869-41ec-8576-4f8a4e60e7f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "cinder-quobyte-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Created reservations ['50d1d1fd-3d7e-4dd2-b3cd-854543eb28a2', '2a3f89e5-a997-427e-968a-d7ac78d05def', '20ec9658-245a-4da2-a122-0adcfe186ed0', '6a969aec-4ac3-45c8-84ba-656a690bb5f6'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "cinder-quobyte-526d2760-6869-41ec-8576-4f8a4e60e7f6" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-526d2760-6869-41ec-8576-4f8a4e60e7f6" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Deleting offline snapshot 526d2760-6869-41ec-8576-4f8a4e60e7f6 of volume a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] snapshot_file for this snap is: volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5570463d-c6bc-4b0f-956d-b2c00c355251]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:54 devstack sudo[103577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:18:54 devstack sudo[103577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:54 devstack sudo[103552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 Sep 01 02:18:54 devstack sudo[103552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:54 devstack sudo[103577]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.296s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:54 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Deleted volume successfully. Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2067850f-a571-49dc-aa48-ad3540b9be19 tempest-CinderUnicodeTest-582883069 None] Lock "cinder-a248b2c3-d92a-414d-8f95-0d16254160f6-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:54 devstack sudo[103552]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6" returned: 0 in 0.519s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb187dd2-826a-48c8-b858-1fe73148e484]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:54 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae Sep 01 02:18:54 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:55 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" returned: 0 in 0.577s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:55 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 Sep 01 02:18:55 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:55 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6" returned: 0 in 0.397s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:55 devstack sudo[103608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6 Sep 01 02:18:55 devstack sudo[103608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:56 devstack sudo[103608]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae.526d2760-6869-41ec-8576-4f8a4e60e7f6" returned: 0 in 0.314s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-526d2760-6869-41ec-8576-4f8a4e60e7f6" released by "_delete_snapshot" :: held 1.925s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" released by "delete_snapshot" :: held 1.980s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:56 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Created reservations ['ec401707-cbbf-4fc8-ac02-4b3829681cf1', '837a03db-8afd-46a2-8ebb-889787c80c1f', '00f26305-c918-45cc-b8a2-2d982ab3890b', '020e3e6a-68f2-4bf3-9276-5adb0def76bb'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:56 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Delete snapshot completed successfully. Sep 01 02:18:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-81ff3066-413b-4d57-bc1b-cf7dd39b7801 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-526d2760-6869-41ec-8576-4f8a4e60e7f6-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "cinder-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "cinder-quobyte-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:57 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c18f10a-dc76-4659-8c89-bffb1cc7386e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:57 devstack sudo[103615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae Sep 01 02:18:57 devstack sudo[103615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:57 devstack sudo[103615]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" returned: 0 in 0.397s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:57 devstack sudo[103621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae Sep 01 02:18:57 devstack sudo[103621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:58 devstack sudo[103621]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" returned: 0 in 0.309s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae" released by "delete_volume" :: held 0.792s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Created reservations ['c5314477-813c-4339-8287-243ee0f51390', '1e3b1342-5810-4fba-aeaf-6d62708d0c5d', '33943d12-a9b8-467b-a2c3-23c3bb677e65', '7cf67357-bf44-411a-81e8-952c06611847'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:58 devstack sudo[103624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:18:58 devstack sudo[103624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "cinder-1da6a138-424e-4468-a33f-af3361f4979b-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-1da6a138-424e-4468-a33f-af3361f4979b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "cinder-quobyte-1da6a138-424e-4468-a33f-af3361f4979b" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-1da6a138-424e-4468-a33f-af3361f4979b" acquired by "delete_volume" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:18:58 devstack sudo[103624]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.306s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:58 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Deleted volume successfully. Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3b90e7-7ae2-42e0-8a16-5c5886398ee9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-84d3ce48-61d5-4c91-ad68-4edff9d10537 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-a37c0235-1b3a-4c2c-8633-b2e3df2ac3ae-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:58 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b Sep 01 02:18:58 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:59 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b" returned: 0 in 0.382s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:59 devstack sudo[103632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b Sep 01 02:18:59 devstack sudo[103632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:59 devstack sudo[103632]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1da6a138-424e-4468-a33f-af3361f4979b" returned: 0 in 0.273s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-quobyte-1da6a138-424e-4468-a33f-af3361f4979b" released by "delete_volume" :: held 0.707s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Flow 'volume_create_manager' (fdcf5b45-9b93-4189-ae77-a255df5c7494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75a59cc-bfae-4d29-bd82-54bc62543080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d75a59cc-bfae-4d29-bd82-54bc62543080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095913511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52c11fd-186d-43ff-875b-fa182e507fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69cd90deacf4556966eb8a5e6b881df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:59Z,use_quota=True,user_id='5006e3e054104e95932039c55448b33b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074a3fb1-e696-41aa-ab0c-f51a67bf6dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074a3fb1-e696-41aa-ab0c-f51a67bf6dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e4deef-9c18-447c-b709-d51ee0fde5e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53e4deef-9c18-447c-b709-d51ee0fde5e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd52c11fd-186d-43ff-875b-fa182e507fc7', 'volume_name': 'volume-d52c11fd-186d-43ff-875b-fa182e507fc7', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472ed212-613a-40c6-ad85-a081344d4a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (472ed212-613a-40c6-ad85-a081344d4a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103ee4af-c855-4e64-803d-b3b42b28c0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:18:59 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Volume d52c11fd-186d-43ff-875b-fa182e507fc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d52c11fd-186d-43ff-875b-fa182e507fc7', 'volume_size': 1} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095913511',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d52c11fd-186d-43ff-875b-fa182e507fc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69cd90deacf4556966eb8a5e6b881df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:18:59Z,use_quota=True,user_id='5006e3e054104e95932039c55448b33b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Creating volume d52c11fd-186d-43ff-875b-fa182e507fc7 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:18:59 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Created reservations ['05a6e11d-8c37-4eff-aa92-8a0efea311f9', '384b261c-b4fd-4d32-9234-d0de034acb71', '8d82f03d-48e9-40bf-bb77-c6487ea7830a', '9d5d57fa-0046-434f-8e8d-3e513bc5d927'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:18:59 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7 1073741824 Sep 01 02:18:59 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:18:59 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:18:59 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:18:59 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.298s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:18:59 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Deleted volume successfully. Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ede3ff9b-d313-4c98-ad82-cc0d15404337 tempest-SnapshotDependencyTests-1952083615 None] Lock "cinder-1da6a138-424e-4468-a33f-af3361f4979b-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:18:59 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7 1073741824" returned: 0 in 0.490s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:18:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:00 devstack sudo[103645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7 Sep 01 02:19:00 devstack sudo[103645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:00 devstack sudo[103645]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7" returned: 0 in 0.247s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103ee4af-c855-4e64-803d-b3b42b28c0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d52c11fd-186d-43ff-875b-fa182e507fc7', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd589827-b285-4c4b-9b31-11196af14b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:00 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Volume volume-d52c11fd-186d-43ff-875b-fa182e507fc7 (d52c11fd-186d-43ff-875b-fa182e507fc7): created successfully Sep 01 02:19:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd589827-b285-4c4b-9b31-11196af14b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Flow 'volume_create_manager' (fdcf5b45-9b93-4189-ae77-a255df5c7494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a7d81259-79f2-4ba5-9690-48f865d48bfc tempest-ProjectReaderTests-1473892673 None] Created volume successfully. Sep 01 02:19:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Acquiring lock "cinder-d52c11fd-186d-43ff-875b-fa182e507fc7-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Lock "cinder-d52c11fd-186d-43ff-875b-fa182e507fc7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Acquiring lock "cinder-quobyte-d52c11fd-186d-43ff-875b-fa182e507fc7" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Lock "cinder-quobyte-d52c11fd-186d-43ff-875b-fa182e507fc7" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:01 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4080970d-e254-4cc7-b0c1-05ca83ecd970]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:01 devstack sudo[103649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7 Sep 01 02:19:01 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:02 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7" returned: 0 in 0.433s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:02 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7 Sep 01 02:19:02 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:02 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d52c11fd-186d-43ff-875b-fa182e507fc7" returned: 0 in 0.319s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Lock "cinder-quobyte-d52c11fd-186d-43ff-875b-fa182e507fc7" released by "delete_volume" :: held 0.800s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Created reservations ['38d30b26-1c0d-4a6c-99d3-b290fb353c58', 'f0ee91eb-46ec-4832-9abe-564e8eae95b7', 'f692ec8a-9271-4148-ae9f-2db2a02ebbab', '172008fc-8632-4547-b6eb-8a6dedd92b34'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:02 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:19:02 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:02 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.275s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:02 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:03 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Deleted volume successfully. Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-334b9dd4-cea0-4e9d-abdc-367806367501 tempest-ProjectReaderTests-1473892673 None] Lock "cinder-d52c11fd-186d-43ff-875b-fa182e507fc7-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Flow 'volume_create_manager' (c04c72e8-0702-4c04-b82c-42940c54f6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d3a0a7-fc18-4e78-b676-e6dd146c3918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5d3a0a7-fc18-4e78-b676-e6dd146c3918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992715413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788c6c5e-2dc2-4c70-ac77-88acfa577230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69cd90deacf4556966eb8a5e6b881df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:03Z,use_quota=True,user_id='5006e3e054104e95932039c55448b33b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f27a837-6429-4602-b216-f88f9bb93763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f27a837-6429-4602-b216-f88f9bb93763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ba09f9-9c84-4053-a25d-f7b41c465cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ba09f9-9c84-4053-a25d-f7b41c465cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '788c6c5e-2dc2-4c70-ac77-88acfa577230', 'volume_name': 'volume-788c6c5e-2dc2-4c70-ac77-88acfa577230', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149caa98-9c1d-4951-831a-722e69f646b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (149caa98-9c1d-4951-831a-722e69f646b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f56aa37-e19a-4a4e-886a-6c9b1c934683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:03 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Volume 788c6c5e-2dc2-4c70-ac77-88acfa577230: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-788c6c5e-2dc2-4c70-ac77-88acfa577230', 'volume_size': 1} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992715413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788c6c5e-2dc2-4c70-ac77-88acfa577230,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d69cd90deacf4556966eb8a5e6b881df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:03Z,use_quota=True,user_id='5006e3e054104e95932039c55448b33b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Creating volume 788c6c5e-2dc2-4c70-ac77-88acfa577230 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:03 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:19:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:03 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230 1073741824 Sep 01 02:19:03 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:04 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230 1073741824" returned: 0 in 0.619s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:04 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230 Sep 01 02:19:04 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:04 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230" returned: 0 in 0.301s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f56aa37-e19a-4a4e-886a-6c9b1c934683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-788c6c5e-2dc2-4c70-ac77-88acfa577230', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed5f263-3992-4383-b81c-53e063f973fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:04 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Volume volume-788c6c5e-2dc2-4c70-ac77-88acfa577230 (788c6c5e-2dc2-4c70-ac77-88acfa577230): created successfully Sep 01 02:19:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed5f263-3992-4383-b81c-53e063f973fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Flow 'volume_create_manager' (c04c72e8-0702-4c04-b82c-42940c54f6a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:04 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1b925b55-ee56-46cd-b7c9-797650c6473f tempest-ProjectReaderTests-1473892673 None] Created volume successfully. Sep 01 02:19:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Acquiring lock "cinder-788c6c5e-2dc2-4c70-ac77-88acfa577230-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Lock "cinder-788c6c5e-2dc2-4c70-ac77-88acfa577230-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Acquiring lock "cinder-quobyte-788c6c5e-2dc2-4c70-ac77-88acfa577230" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Lock "cinder-quobyte-788c6c5e-2dc2-4c70-ac77-88acfa577230" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:05 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c757d4b6-a55e-4a0b-abe4-4e7452a50eba]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:05 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230 Sep 01 02:19:05 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:06 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230" returned: 0 in 0.390s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:06 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230 Sep 01 02:19:06 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:06 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-788c6c5e-2dc2-4c70-ac77-88acfa577230" returned: 0 in 0.265s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Lock "cinder-quobyte-788c6c5e-2dc2-4c70-ac77-88acfa577230" released by "delete_volume" :: held 0.698s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Created reservations ['962b4023-d869-4fdd-92b1-4ad9ea881661', 'e530f64b-bcbe-4949-8c4c-f893029b7626', 'cbea9331-357d-4986-8516-f35062fb01ff', 'd5e1eac6-492f-40b7-92e7-aeeb90bb1f1b'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:06 devstack sudo[103687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:19:06 devstack sudo[103687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:06 devstack sudo[103687]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.345s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:06 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Deleted volume successfully. Sep 01 02:19:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d326ec01-344d-48fb-b9ba-d8942de50e3e tempest-ProjectReaderTests-1473892673 None] Lock "cinder-788c6c5e-2dc2-4c70-ac77-88acfa577230-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:07 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=151,cinder:SELECT=117,cinder:DELETE=16,cinder:INSERT=35 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-cf3ae48d-181f-4a69-a511-154bc37d03cf req-0e23037c-0dec-4ff2-bd82-682214d6eb2c tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-cf3ae48d-181f-4a69-a511-154bc37d03cf req-0e23037c-0dec-4ff2-bd82-682214d6eb2c tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-cf3ae48d-181f-4a69-a511-154bc37d03cf req-0e23037c-0dec-4ff2-bd82-682214d6eb2c tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:07 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-cf3ae48d-181f-4a69-a511-154bc37d03cf req-0e23037c-0dec-4ff2-bd82-682214d6eb2c tempest-TestInstancesWithCinderVolumes-306265532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-deaebd72-c5ea-40d9-823f-6953494a29d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ca65c07e-e7f3-4683-a94d-95bc63a5b5b8', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:19:07 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-cf3ae48d-181f-4a69-a511-154bc37d03cf req-0e23037c-0dec-4ff2-bd82-682214d6eb2c tempest-TestInstancesWithCinderVolumes-306265532 None] attachment_update completed successfully. Sep 01 02:19:10 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=123,cinder:UPDATE=145,cinder:INSERT=42,cinder:DELETE=11 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-62f8387b-a9ee-4287-a694-79a196b5b96c req-449dd90c-f4b0-4886-925f-0dec0c9988e3 tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-62f8387b-a9ee-4287-a694-79a196b5b96c req-449dd90c-f4b0-4886-925f-0dec0c9988e3 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-62f8387b-a9ee-4287-a694-79a196b5b96c req-449dd90c-f4b0-4886-925f-0dec0c9988e3 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-62f8387b-a9ee-4287-a694-79a196b5b96c req-449dd90c-f4b0-4886-925f-0dec0c9988e3 tempest-TestInstancesWithCinderVolumes-306265532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebea07ca-a3e8-46db-83f7-4f5588dab228', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:19:10 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-62f8387b-a9ee-4287-a694-79a196b5b96c req-449dd90c-f4b0-4886-925f-0dec0c9988e3 tempest-TestInstancesWithCinderVolumes-306265532 None] attachment_update completed successfully. Sep 01 02:19:15 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-96492eab-df40-491d-9cd4-691ad3c672d2 req-2e90e512-c6a5-4264-b17d-0486ac70ba04 tempest-TestInstancesWithCinderVolumes-306265532 None] Terminate volume connection completed successfully. Sep 01 02:19:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-96492eab-df40-491d-9cd4-691ad3c672d2 req-2e90e512-c6a5-4264-b17d-0486ac70ba04 tempest-TestInstancesWithCinderVolumes-306265532 None] Deleting attachment ca65c07e-e7f3-4683-a94d-95bc63a5b5b8. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "cinder-deaebd72-c5ea-40d9-823f-6953494a29d1-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-deaebd72-c5ea-40d9-823f-6953494a29d1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "cinder-quobyte-deaebd72-c5ea-40d9-823f-6953494a29d1" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-quobyte-deaebd72-c5ea-40d9-823f-6953494a29d1" acquired by "delete_volume" :: waited 0.014s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[483957d0-b5c8-451a-9167-564772d31c3e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:16 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1 Sep 01 02:19:16 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:16 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1" returned: 0 in 0.400s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:16 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1 Sep 01 02:19:16 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:16 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-deaebd72-c5ea-40d9-823f-6953494a29d1" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-quobyte-deaebd72-c5ea-40d9-823f-6953494a29d1" released by "delete_volume" :: held 0.710s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:16 devstack cinder-volume[87389]: WARNING cinder.quota [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652074192-2042661214 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652074192-2042661214, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:16 devstack cinder-volume[87389]: WARNING cinder.quota [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652074192-2042661214 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1652074192-2042661214, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Created reservations ['937522c4-3538-46d5-83aa-f47e34dad94b', '3c7b5814-d933-484f-beb6-944370c707ef', 'da599071-529f-4280-b85d-86ae29d5913b', 'e2e7fad0-4e7a-4220-bd82-8392a9f4cf22'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:17 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:19:17 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:17 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.271s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:17 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:17 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Deleted volume successfully. Sep 01 02:19:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebaad7f5-f8cb-4676-9565-0500c79066bd tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-deaebd72-c5ea-40d9-823f-6953494a29d1-delete_volume" released by "delete_volume" :: held 1.209s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-e326b711-bab0-4ad0-8985-279fcd7ccc2a req-f29c09c5-ec17-4beb-8ef7-bafef8330958 tempest-TestInstancesWithCinderVolumes-306265532 None] Terminate volume connection completed successfully. Sep 01 02:19:19 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-e326b711-bab0-4ad0-8985-279fcd7ccc2a req-f29c09c5-ec17-4beb-8ef7-bafef8330958 tempest-TestInstancesWithCinderVolumes-306265532 None] Deleting attachment ebea07ca-a3e8-46db-83f7-4f5588dab228. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:19:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "cinder-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "cinder-quobyte-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-quobyte-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:20 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3330bb3-3696-4f94-8d4c-cb9085cefb1a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:20 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1 Sep 01 02:19:20 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:20 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1" returned: 0 in 0.374s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:20 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1 Sep 01 02:19:20 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:21 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1" returned: 0 in 0.262s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-quobyte-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1" released by "delete_volume" :: held 0.682s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:21 devstack cinder-volume[87389]: WARNING cinder.quota [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-199935480-236035860 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-199935480-236035860, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:21 devstack cinder-volume[87389]: WARNING cinder.quota [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-199935480-236035860 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-199935480-236035860, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Created reservations ['67b5868c-8101-4c9c-a87f-93370f6d1e32', '36d1a95a-f487-425e-832c-659686a0588c', 'a32f28c7-da46-416d-84ae-8518a82a67da', '3ede1277-a9aa-4eb6-a606-f4154f306a8f'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:21 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:19:21 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:21 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.260s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Deleted volume successfully. Sep 01 02:19:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-960451be-39fe-4bf2-af99-1f7aa639db08 tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-5d15eb21-1cbd-40aa-bb0b-de17e3a582a1-delete_volume" released by "delete_volume" :: held 1.179s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:24 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-6790a012-dcfd-41a5-b47b-640c739c86aa req-5a6f88ff-b305-4328-a5d9-ad505c3daa7a tempest-TestInstancesWithCinderVolumes-306265532 None] Terminate volume connection completed successfully. Sep 01 02:19:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-6790a012-dcfd-41a5-b47b-640c739c86aa req-5a6f88ff-b305-4328-a5d9-ad505c3daa7a tempest-TestInstancesWithCinderVolumes-306265532 None] Deleting attachment 613d89ec-0593-4222-b3d4-d876c1ccc54c. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:19:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "cinder-df0697b6-bc20-4a01-bf2c-1cf3165a63c2-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-df0697b6-bc20-4a01-bf2c-1cf3165a63c2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "cinder-quobyte-df0697b6-bc20-4a01-bf2c-1cf3165a63c2" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:19:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-quobyte-df0697b6-bc20-4a01-bf2c-1cf3165a63c2" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:19:25 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa44f96-80c3-41ec-9a87-1a7e7f9403ce]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:19:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:25 devstack sudo[103845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 Sep 01 02:19:25 devstack sudo[103845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:25 devstack sudo[103845]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2" returned: 0 in 0.362s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:25 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2 Sep 01 02:19:25 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:25 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-df0697b6-bc20-4a01-bf2c-1cf3165a63c2" returned: 0 in 0.244s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:26 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-quobyte-df0697b6-bc20-4a01-bf2c-1cf3165a63c2" released by "delete_volume" :: held 0.649s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:26 devstack cinder-volume[87389]: WARNING cinder.quota [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-74309376-1130333036 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-74309376-1130333036, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:26 devstack cinder-volume[87389]: WARNING cinder.quota [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-74309376-1130333036 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-74309376-1130333036, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:19:26 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Created reservations ['26e2d43f-6848-4f8a-97ef-2d571100f7ad', '3c4b7ffa-fd98-4527-9fd8-de08d5ed4924', '9cb0f930-38c7-40d2-89e5-e0f03908d097', 'aa0c7db3-b753-4e46-baeb-20574d7721fe'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:19:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:26 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:19:26 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:26 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.242s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:26 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:26 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Deleted volume successfully. Sep 01 02:19:26 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ffd0ea93-20d0-4223-9e1d-ccef77d31b9f tempest-TestInstancesWithCinderVolumes-306265532 None] Lock "cinder-df0697b6-bc20-4a01-bf2c-1cf3165a63c2-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:19:36 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=6 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:36 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=30,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:47 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:19:47 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:47 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.249s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:19:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Flow 'volume_create_manager' (b1293271-ac6c-417c-b027-08f343eefc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4711b5-fc76-49a4-9b76-0fe588b4627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4711b5-fc76-49a4-9b76-0fe588b4627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2082810588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1061675-99f7-47d8-91cc-c585f4b11db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43f0b00d564f1ba2122ae2d0767f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:57Z,use_quota=True,user_id='118a67982dcf409eb6b5780ae0a33c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068eacdc-88cc-438f-8f72-802f7a15e2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (068eacdc-88cc-438f-8f72-802f7a15e2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef7a6b3-29ae-4914-ba25-50d48e147d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef7a6b3-29ae-4914-ba25-50d48e147d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1061675-99f7-47d8-91cc-c585f4b11db0', 'volume_name': 'volume-f1061675-99f7-47d8-91cc-c585f4b11db0', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d320d6d-cd66-4c7b-b344-c7002038b00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d320d6d-cd66-4c7b-b344-c7002038b00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f61de7-da63-4ea6-ad74-25cb626184e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Volume f1061675-99f7-47d8-91cc-c585f4b11db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1061675-99f7-47d8-91cc-c585f4b11db0', 'volume_size': 1} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2082810588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1061675-99f7-47d8-91cc-c585f4b11db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43f0b00d564f1ba2122ae2d0767f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:57Z,use_quota=True,user_id='118a67982dcf409eb6b5780ae0a33c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Creating volume f1061675-99f7-47d8-91cc-c585f4b11db0 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:57 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:57 devstack sudo[103904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0 1073741824 Sep 01 02:19:57 devstack sudo[103904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Flow 'volume_create_manager' (b404ebc2-0ee4-4176-a045-7d06b11d9985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bd781f-f44f-4c5d-85f3-64e056764014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21bd781f-f44f-4c5d-85f3-64e056764014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1266817877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d3f3c3-f851-4030-90ef-a8be784e0a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43f0b00d564f1ba2122ae2d0767f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:58Z,use_quota=True,user_id='118a67982dcf409eb6b5780ae0a33c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3d0688-bab2-4adb-aa78-e5af6490075d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3d0688-bab2-4adb-aa78-e5af6490075d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1242562b-4102-4af2-872a-23edce490dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1242562b-4102-4af2-872a-23edce490dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43d3f3c3-f851-4030-90ef-a8be784e0a8e', 'volume_name': 'volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5dea04-c713-4f7a-ac5c-7af0b91d4540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5dea04-c713-4f7a-ac5c-7af0b91d4540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84ebf85-f1dd-4bb9-9b6b-e46a95bb2276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:57 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Volume 43d3f3c3-f851-4030-90ef-a8be784e0a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e', 'volume_size': 1} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:57 devstack sudo[103904]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0 1073741824" returned: 0 in 0.566s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:57 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0 Sep 01 02:19:57 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:58 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0" returned: 0 in 0.267s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1266817877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d3f3c3-f851-4030-90ef-a8be784e0a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c43f0b00d564f1ba2122ae2d0767f1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:19:58Z,use_quota=True,user_id='118a67982dcf409eb6b5780ae0a33c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Creating volume 43d3f3c3-f851-4030-90ef-a8be784e0a8e {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:19:58 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f61de7-da63-4ea6-ad74-25cb626184e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1061675-99f7-47d8-91cc-c585f4b11db0', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:58 devstack sudo[103912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e 1073741824 Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e5bd98-43db-4358-81e9-316dd1a0225c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:58 devstack sudo[103912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:58 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Volume volume-f1061675-99f7-47d8-91cc-c585f4b11db0 (f1061675-99f7-47d8-91cc-c585f4b11db0): created successfully Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e5bd98-43db-4358-81e9-316dd1a0225c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Flow 'volume_create_manager' (b1293271-ac6c-417c-b027-08f343eefc6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:58 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f4504a9a-78e3-4f02-a50b-0a21b17c56cf tempest-TestServerVolumeAttachmentScenario-1457710638 None] Created volume successfully. Sep 01 02:19:58 devstack sudo[103912]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e 1073741824" returned: 0 in 0.472s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:19:58 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e Sep 01 02:19:58 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:19:58 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e" returned: 0 in 0.251s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e84ebf85-f1dd-4bb9-9b6b-e46a95bb2276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b4b254-76a4-41b8-9441-14021f7f30c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:19:58 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Volume volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e (43d3f3c3-f851-4030-90ef-a8be784e0a8e): created successfully Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b4b254-76a4-41b8-9441-14021f7f30c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:19:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Flow 'volume_create_manager' (b404ebc2-0ee4-4176-a045-7d06b11d9985) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:19:59 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d72f8c30-779f-4507-9f84-5a3041bfbcdd tempest-TestServerVolumeAttachmentScenario-1457710638 None] Created volume successfully. Sep 01 02:20:09 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=6,cinder:SELECT=3,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:09 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:20:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-d40adc32-bb57-4d13-9c5f-be66fab3e1ed req-600c3dbc-acf8-42c2-90a3-ca0d87a6bb4e tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-d40adc32-bb57-4d13-9c5f-be66fab3e1ed req-600c3dbc-acf8-42c2-90a3-ca0d87a6bb4e tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-d40adc32-bb57-4d13-9c5f-be66fab3e1ed req-600c3dbc-acf8-42c2-90a3-ca0d87a6bb4e tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:28 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-d40adc32-bb57-4d13-9c5f-be66fab3e1ed req-600c3dbc-acf8-42c2-90a3-ca0d87a6bb4e tempest-TestServerVolumeAttachmentScenario-1457710638 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-f1061675-99f7-47d8-91cc-c585f4b11db0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1c2b2be-e037-4f02-ba56-beb33ad3f6f6', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:20:28 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-d40adc32-bb57-4d13-9c5f-be66fab3e1ed req-600c3dbc-acf8-42c2-90a3-ca0d87a6bb4e tempest-TestServerVolumeAttachmentScenario-1457710638 None] attachment_update completed successfully. Sep 01 02:20:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-52595764-6e80-4d5d-a74f-3c839687063d req-152015a7-49d1-4998-bee6-cfbf799432d9 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-52595764-6e80-4d5d-a74f-3c839687063d req-152015a7-49d1-4998-bee6-cfbf799432d9 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [req-52595764-6e80-4d5d-a74f-3c839687063d req-152015a7-49d1-4998-bee6-cfbf799432d9 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:32 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-52595764-6e80-4d5d-a74f-3c839687063d req-152015a7-49d1-4998-bee6-cfbf799432d9 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be', 'name': 'volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bd89e014-bcab-4853-bcdd-68d2290dd176', 'enforce_multipath': True} {{(pid=87389) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 01 02:20:33 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-52595764-6e80-4d5d-a74f-3c839687063d req-152015a7-49d1-4998-bee6-cfbf799432d9 tempest-TestServerVolumeAttachmentScenario-1457710638 None] attachment_update completed successfully. Sep 01 02:20:34 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-ea3c3242-f30c-4b9d-ae67-781f86c3439a req-ee8250cc-53b6-46b4-9941-de488e0a0731 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Terminate volume connection completed successfully. Sep 01 02:20:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-ea3c3242-f30c-4b9d-ae67-781f86c3439a req-ee8250cc-53b6-46b4-9941-de488e0a0731 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Deleting attachment bd89e014-bcab-4853-bcdd-68d2290dd176. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:20:35 devstack cinder-volume[87389]: INFO cinder.volume.manager [req-ab99f87a-d6a2-4bd6-908c-4e92e89ac99a req-ef9b143e-8f11-4164-b240-32880facbae1 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Terminate volume connection completed successfully. Sep 01 02:20:35 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [req-ab99f87a-d6a2-4bd6-908c-4e92e89ac99a req-ef9b143e-8f11-4164-b240-32880facbae1 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Deleting attachment b1c2b2be-e037-4f02-ba56-beb33ad3f6f6. {{(pid=87389) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 01 02:20:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "cinder-43d3f3c3-f851-4030-90ef-a8be784e0a8e-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "cinder-43d3f3c3-f851-4030-90ef-a8be784e0a8e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "cinder-quobyte-43d3f3c3-f851-4030-90ef-a8be784e0a8e" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "cinder-quobyte-43d3f3c3-f851-4030-90ef-a8be784e0a8e" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:40 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9035d857-2b49-4dc6-9be5-1260fc42b995]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:40 devstack sudo[104540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e Sep 01 02:20:40 devstack sudo[104540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:41 devstack sudo[104540]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e" returned: 0 in 0.374s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:41 devstack sudo[104545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e Sep 01 02:20:41 devstack sudo[104545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:41 devstack sudo[104545]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-43d3f3c3-f851-4030-90ef-a8be784e0a8e" returned: 0 in 0.248s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "cinder-quobyte-43d3f3c3-f851-4030-90ef-a8be784e0a8e" released by "delete_volume" :: held 0.666s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Created reservations ['3687e62b-0072-4b99-9483-1785b1dcbe1b', 'd40ae309-a9ca-496c-823a-c5c085ec23fa', 'cf4f23db-3dd0-4301-9941-958929bbb76b', 'b2d54257-283f-4ebb-92f8-4040d3bc5d36'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:41 devstack sudo[104548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:20:41 devstack sudo[104548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:41 devstack sudo[104548]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.262s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Deleted volume successfully. Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "cinder-f1061675-99f7-47d8-91cc-c585f4b11db0-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-93c71c2e-c68b-4afe-bb96-60f45db43638 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "cinder-43d3f3c3-f851-4030-90ef-a8be784e0a8e-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "cinder-f1061675-99f7-47d8-91cc-c585f4b11db0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "cinder-quobyte-f1061675-99f7-47d8-91cc-c585f4b11db0" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "cinder-quobyte-f1061675-99f7-47d8-91cc-c585f4b11db0" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e071f461-1498-46bc-bb9d-eef33b249724]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:41 devstack sudo[104551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0 Sep 01 02:20:41 devstack sudo[104551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:42 devstack sudo[104551]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0" returned: 0 in 0.370s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:42 devstack sudo[104556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0 Sep 01 02:20:42 devstack sudo[104556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:42 devstack sudo[104556]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f1061675-99f7-47d8-91cc-c585f4b11db0" returned: 0 in 0.256s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "cinder-quobyte-f1061675-99f7-47d8-91cc-c585f4b11db0" released by "delete_volume" :: held 0.670s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Created reservations ['025f4a39-8b1a-437b-b0fe-f4ce6296d884', '871c36e3-4d54-48ed-b289-e637a5c1020e', 'de5a86ba-be3d-4a0f-b4ff-6e9ea01094a5', '0113ec17-83a9-4538-bcf3-5cf76c478d31'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:42 devstack sudo[104559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:20:42 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:42 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.245s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:42 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Deleted volume successfully. Sep 01 02:20:42 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-da5e50c6-22b7-448a-a4c2-1a56ea62f4f2 tempest-TestServerVolumeAttachmentScenario-1457710638 None] Lock "cinder-f1061675-99f7-47d8-91cc-c585f4b11db0-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:47 devstack sudo[104565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:20:47 devstack sudo[104565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:47 devstack sudo[104565]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.258s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:20:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Flow 'volume_create_manager' (ae8b068c-a721-44a0-8753-75252a8db1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f20e89-8a64-4036-bcdf-8f1ac7f950ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f20e89-8a64-4036-bcdf-8f1ac7f950ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53682e4-63da-4ede-a7eb-6b01a2159501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072cbbdff53e48158d07b3d939ca3fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:57Z,use_quota=True,user_id='01c7ee1ceb96461e94c3aa2ec1bce401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7df0cdd6-5627-4714-bdd3-a025021dfc1c),volume_type_id=7df0cdd6-5627-4714-bdd3-a025021dfc1c)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49770605-2ade-4f8a-87b4-76b56ba626fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49770605-2ade-4f8a-87b4-76b56ba626fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b850074-fd24-482c-965c-acd99562370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.image.glance [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Creating Keystone auth plugin from conf {{(pid=87389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b850074-fd24-482c-965c-acd99562370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e53682e4-63da-4ede-a7eb-6b01a2159501', 'volume_name': 'volume-e53682e4-63da-4ede-a7eb-6b01a2159501', 'volume_size': 1, 'image_id': 'a4f2790f-0044-47f6-8a46-ce0728de0a77', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4f2790f-0044-47f6-8a46-ce0728de0a77', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d23bb89a03830e38c19a95003784e33', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '072cbbdff53e48158d07b3d939ca3fbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd7b29fa158b320b34ae7aa16c8c4fddac52e7b59ebdd94400da9e871152ca926171fb3acb77ea78c1bbd439c915f551bc2d615d9134bf08b03c3648d2a48b46', 'id': 'a4f2790f-0044-47f6-8a46-ce0728de0a77', 'created_at': datetime.datetime(2026, 9, 1, 0, 20, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 20, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4f2790f-0044-47f6-8a46-ce0728de0a77/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd0db83-d764-4b57-822d-e3c502562841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fd0db83-d764-4b57-822d-e3c502562841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b89104b-94ba-4f70-ac82-5e9df143988f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:20:57 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Volume e53682e4-63da-4ede-a7eb-6b01a2159501: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e53682e4-63da-4ede-a7eb-6b01a2159501', 'volume_size': 1, 'image_id': 'a4f2790f-0044-47f6-8a46-ce0728de0a77', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4f2790f-0044-47f6-8a46-ce0728de0a77', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d23bb89a03830e38c19a95003784e33', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '072cbbdff53e48158d07b3d939ca3fbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd7b29fa158b320b34ae7aa16c8c4fddac52e7b59ebdd94400da9e871152ca926171fb3acb77ea78c1bbd439c915f551bc2d615d9134bf08b03c3648d2a48b46', 'id': 'a4f2790f-0044-47f6-8a46-ce0728de0a77', 'created_at': datetime.datetime(2026, 9, 1, 0, 20, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 20, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4f2790f-0044-47f6-8a46-ce0728de0a77/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Trying to clone e53682e4-63da-4ede-a7eb-6b01a2159501 from image a4f2790f-0044-47f6-8a46-ce0728de0a77 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a4f2790f-0044-47f6-8a46-ce0728de0a77', 'metadata': {}}]). {{(pid=87389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:20:57 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2bf8bd-eeba-466a-8901-e142930f3e57]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:58 devstack sudo[104571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD Sep 01 02:20:58 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:58 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:58 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD Sep 01 02:20:58 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:58 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:20:58 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Temporary image a4f2790f-0044-47f6-8a46-ce0728de0a77 is fetched for user 01c7ee1ceb96461e94c3aa2ec1bce401. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:20:58 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc54ea3-6c50-4cdf-a886-538960141779]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:20:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:58 devstack sudo[104582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD Sep 01 02:20:58 devstack sudo[104582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:58 devstack sudo[104582]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:59 devstack sudo[104586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD Sep 01 02:20:59 devstack sudo[104586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:59 devstack sudo[104586]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD" returned: 1 in 0.325s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53682e4-63da-4ede-a7eb-6b01a2159501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='072cbbdff53e48158d07b3d939ca3fbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:20:57Z,use_quota=True,user_id='01c7ee1ceb96461e94c3aa2ec1bce401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7df0cdd6-5627-4714-bdd3-a025021dfc1c),volume_type_id=7df0cdd6-5627-4714-bdd3-a025021dfc1c)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Creating volume e53682e4-63da-4ede-a7eb-6b01a2159501 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:20:59 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:59 devstack sudo[104591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 1073741824 Sep 01 02:20:59 devstack sudo[104591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:20:59 devstack sudo[104591]: pam_unix(sudo:session): session closed for user root Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 1073741824" returned: 0 in 0.403s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:20:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:20:59 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 Sep 01 02:20:59 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:00 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501" returned: 0 in 0.249s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Attempting download of a4f2790f-0044-47f6-8a46-ce0728de0a77 ((None, [{'url': 'file:///opt/stack/data/glance/images/a4f2790f-0044-47f6-8a46-ce0728de0a77', 'metadata': {}}])) to volume e53682e4-63da-4ede-a7eb-6b01a2159501. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4f4804-e07c-4b1e-92a5-6c1a9f0ce8b2]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4f2790f-0044-47f6-8a46-ce0728de0a77_dd4qigrc {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:00 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4f2790f-0044-47f6-8a46-ce0728de0a77_dd4qigrc Sep 01 02:21:00 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:00 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a4f2790f-0044-47f6-8a46-ce0728de0a77_dd4qigrc" returned: 0 in 0.320s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4f2790f-0044-47f6-8a46-ce0728de0a77_dd4qigrc {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:00 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4f2790f-0044-47f6-8a46-ce0728de0a77_dd4qigrc Sep 01 02:21:00 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:00 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4f2790f-0044-47f6-8a46-ce0728de0a77_dd4qigrc" returned: 1 in 0.315s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a4f2790f-0044-47f6-8a46-ce0728de0a77_dd4qigrc' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd8ee5d-32c1-4ac6-91aa-968f3c7b6b1e]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:00 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD Sep 01 02:21:00 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:01 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:01 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD Sep 01 02:21:01 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:01 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD" returned: 1 in 0.310s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:21:01 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] a4f2790f-0044-47f6-8a46-ce0728de0a77 was raw, converting to qcow2 {{(pid=87389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:21:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:01 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 Sep 01 02:21:01 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:01 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501" returned: 0 in 0.429s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:01 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a4f2790f-0044-47f6-8a46-ce0728de0a77_t4vmkpwrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:21:01 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:21:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:01 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 1G Sep 01 02:21:01 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:02 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 1G" returned: 0 in 0.296s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Downloaded image a4f2790f-0044-47f6-8a46-ce0728de0a77 ((None, [{'url': 'file:///opt/stack/data/glance/images/a4f2790f-0044-47f6-8a46-ce0728de0a77', 'metadata': {}}])) to volume e53682e4-63da-4ede-a7eb-6b01a2159501 successfully. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Temporary image a4f2790f-0044-47f6-8a46-ce0728de0a77 for user 01c7ee1ceb96461e94c3aa2ec1bce401 is deleted. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Marking volume e53682e4-63da-4ede-a7eb-6b01a2159501 as bootable. {{(pid=87389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Copying metadata from image a4f2790f-0044-47f6-8a46-ce0728de0a77 to e53682e4-63da-4ede-a7eb-6b01a2159501. {{(pid=87389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Creating volume glance metadata for volume e53682e4-63da-4ede-a7eb-6b01a2159501 backed by image a4f2790f-0044-47f6-8a46-ce0728de0a77 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a4f2790f-0044-47f6-8a46-ce0728de0a77', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0d23bb89a03830e38c19a95003784e33', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b89104b-94ba-4f70-ac82-5e9df143988f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53682e4-63da-4ede-a7eb-6b01a2159501', 'volume_size': 1, 'image_id': 'a4f2790f-0044-47f6-8a46-ce0728de0a77', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a4f2790f-0044-47f6-8a46-ce0728de0a77', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0d23bb89a03830e38c19a95003784e33', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '072cbbdff53e48158d07b3d939ca3fbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bd7b29fa158b320b34ae7aa16c8c4fddac52e7b59ebdd94400da9e871152ca926171fb3acb77ea78c1bbd439c915f551bc2d615d9134bf08b03c3648d2a48b46', 'id': 'a4f2790f-0044-47f6-8a46-ce0728de0a77', 'created_at': datetime.datetime(2026, 9, 1, 0, 20, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 20, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a4f2790f-0044-47f6-8a46-ce0728de0a77/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf49c4d-0cde-4452-933b-ea8a4e071eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:02 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Volume volume-e53682e4-63da-4ede-a7eb-6b01a2159501 (e53682e4-63da-4ede-a7eb-6b01a2159501): created successfully Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cf49c4d-0cde-4452-933b-ea8a4e071eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Flow 'volume_create_manager' (ae8b068c-a721-44a0-8753-75252a8db1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:02 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5c12df7a-6496-4778-8d08-6dc3776daabc tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Created volume successfully. Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Acquiring lock "cinder-e53682e4-63da-4ede-a7eb-6b01a2159501-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Lock "cinder-e53682e4-63da-4ede-a7eb-6b01a2159501-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Acquiring lock "cinder-quobyte-e53682e4-63da-4ede-a7eb-6b01a2159501" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Lock "cinder-quobyte-e53682e4-63da-4ede-a7eb-6b01a2159501" acquired by "delete_volume" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f479b7e-e693-44ec-9cff-acea2bee0ff0]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:02 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 Sep 01 02:21:02 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:03 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501" returned: 0 in 0.353s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:03 devstack sudo[104631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501 Sep 01 02:21:03 devstack sudo[104631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:03 devstack sudo[104631]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e53682e4-63da-4ede-a7eb-6b01a2159501" returned: 0 in 0.243s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Lock "cinder-quobyte-e53682e4-63da-4ede-a7eb-6b01a2159501" released by "delete_volume" :: held 0.632s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:03 devstack cinder-volume[87389]: WARNING cinder.quota [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:21:03 devstack cinder-volume[87389]: WARNING cinder.quota [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Created reservations ['93094e6d-1ec5-486d-8e5f-d531c7929dca', '7d686a77-db4b-4969-9328-9709e6b3b67e', '67b833f9-cc1b-4e35-b60a-53d36b10c811', '1090f4b9-e533-4076-aa5b-2e7e037f45ac'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:03 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:03 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:03 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.235s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:03 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Deleted volume successfully. Sep 01 02:21:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-745ee812-1e5d-46fd-9a4e-9ef9ff8f73e8 tempest-VolumeAndVolumeTypeFromImageTest-1647982375 None] Lock "cinder-e53682e4-63da-4ede-a7eb-6b01a2159501-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (59914ac6-318e-4bc4-8a68-e62e96efa297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de386f8-5dba-4289-97b7-c7d4c9030f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de386f8-5dba-4289-97b7-c7d4c9030f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1246597597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd0e66e-7eb4-4a7d-96af-b754b630b34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:08Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78bc6bc-9acd-4c59-9ad6-a769130c170c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78bc6bc-9acd-4c59-9ad6-a769130c170c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c20bef9-ce38-450b-a2ee-c11722a1c87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c20bef9-ce38-450b-a2ee-c11722a1c87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd0e66e-7eb4-4a7d-96af-b754b630b34f', 'volume_name': 'volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba41709c-87c6-4871-af7d-c0509669417c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba41709c-87c6-4871-af7d-c0509669417c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a643d405-835e-4dc1-b7f1-b5f172ab2310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:08 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume ebd0e66e-7eb4-4a7d-96af-b754b630b34f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f', 'volume_size': 1} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1246597597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd0e66e-7eb4-4a7d-96af-b754b630b34f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:08Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Creating volume ebd0e66e-7eb4-4a7d-96af-b754b630b34f {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:08 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:08 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f 1073741824 Sep 01 02:21:08 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:08 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f 1073741824" returned: 0 in 0.406s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:08 devstack sudo[104643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f Sep 01 02:21:08 devstack sudo[104643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:09 devstack sudo[104643]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f" returned: 0 in 0.240s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a643d405-835e-4dc1-b7f1-b5f172ab2310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448cacbb-b722-42e7-b15b-39147a998c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:09 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f (ebd0e66e-7eb4-4a7d-96af-b754b630b34f): created successfully Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448cacbb-b722-42e7-b15b-39147a998c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (59914ac6-318e-4bc4-8a68-e62e96efa297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:09 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-66fd3ceb-0c9b-453c-8298-6f42aa9fc6c6 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created volume successfully. Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Creating offline snapshot d8241080-cf5c-49d9-b07d-74342b8caf08 of volume ebd0e66e-7eb4-4a7d-96af-b754b630b34f {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0d3294-fe3f-4e3b-83c5-8ddf53ac08d0]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:09 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f Sep 01 02:21:09 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:09 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f" returned: 0 in 0.371s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:09 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 1G Sep 01 02:21:09 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:10 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 1G" returned: 0 in 0.386s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:10 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 Sep 01 02:21:10 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:10 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08" returned: 0 in 0.305s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:10 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 is being set with open permissions: ugo+rw Sep 01 02:21:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:10 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 Sep 01 02:21:10 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:10 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08" returned: 0 in 0.253s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:10 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.info Sep 01 02:21:10 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:11 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.info" returned: 0 in 0.287s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:11 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.info is being set with open permissions: ugo+rw Sep 01 02:21:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:11 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.info Sep 01 02:21:11 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:11 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.info" returned: 0 in 0.256s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.957s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:11 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9ad5e8cd-452e-4886-a001-9c404ee76409 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Create snapshot completed successfully Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (d161288e-1102-4975-ab6f-66fa34669535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de294a6d-56d9-45fa-8bd9-3146686a0f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de294a6d-56d9-45fa-8bd9-3146686a0f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-565282543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e840c8b2-4982-4f89-a355-066899c11463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:12Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed55aa1-e3f1-441c-9aab-c653c763c06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed55aa1-e3f1-441c-9aab-c653c763c06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9a6453-2960-4fc1-8521-1cba156ab072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e9a6453-2960-4fc1-8521-1cba156ab072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e840c8b2-4982-4f89-a355-066899c11463', 'volume_name': 'volume-e840c8b2-4982-4f89-a355-066899c11463', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6f9d30-2efb-4f02-b72c-308774ab03a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6f9d30-2efb-4f02-b72c-308774ab03a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aab210b-ff29-4091-beae-028b92f5908d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume e840c8b2-4982-4f89-a355-066899c11463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e840c8b2-4982-4f89-a355-066899c11463', 'volume_size': 1} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-565282543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e840c8b2-4982-4f89-a355-066899c11463,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:12Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Creating volume e840c8b2-4982-4f89-a355-066899c11463 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:12 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:12 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463 1073741824 Sep 01 02:21:12 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (76ba5e32-0713-414f-a745-4ed442013d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75153627-1a07-42fe-a668-a6b8e439fd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75153627-1a07-42fe-a668-a6b8e439fd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635468274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddaaaf77-20d6-4498-998c-75e60c806d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:12Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c0b26f-4a35-46b0-9ae6-961090e98cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c0b26f-4a35-46b0-9ae6-961090e98cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a235d20-b4e4-44e0-8620-3c90a3c2810b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a235d20-b4e4-44e0-8620-3c90a3c2810b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddaaaf77-20d6-4498-998c-75e60c806d5e', 'volume_name': 'volume-ddaaaf77-20d6-4498-998c-75e60c806d5e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df6eba1-6561-4765-842e-e28607d2648e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df6eba1-6561-4765-842e-e28607d2648e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c300735-16d2-41e4-9e5c-6b1a35a86c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume ddaaaf77-20d6-4498-998c-75e60c806d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddaaaf77-20d6-4498-998c-75e60c806d5e', 'volume_size': 1} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:12 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463 1073741824" returned: 0 in 0.481s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:12 devstack sudo[104678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463 Sep 01 02:21:12 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (b26562cd-65c3-4245-aaab-25b88f2f6f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a23b75-4ab9-4557-a1ab-89ff69ce766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37a23b75-4ab9-4557-a1ab-89ff69ce766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-276131835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feb7b00-644a-4cbe-8d3a-80cee714d0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:13Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcfddb4-b5cb-429b-8c8b-af07f97a15ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdcfddb4-b5cb-429b-8c8b-af07f97a15ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec45221-6f6a-4602-a9d5-7cbb18239b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ec45221-6f6a-4602-a9d5-7cbb18239b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3feb7b00-644a-4cbe-8d3a-80cee714d0c9', 'volume_name': 'volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e155c649-6ead-483f-9f81-2e7a140765c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e155c649-6ead-483f-9f81-2e7a140765c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb8ffdb-c6bc-479a-917c-8bd866c5c8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume 3feb7b00-644a-4cbe-8d3a-80cee714d0c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9', 'volume_size': 1} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:12 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463" returned: 0 in 0.299s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1635468274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddaaaf77-20d6-4498-998c-75e60c806d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:12Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Creating volume ddaaaf77-20d6-4498-998c-75e60c806d5e {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:12 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aab210b-ff29-4091-beae-028b92f5908d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e840c8b2-4982-4f89-a355-066899c11463', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:12 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e 1073741824 Sep 01 02:21:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b166c8-5798-4ea0-8fd9-19c5222de75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:12 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:13 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume volume-e840c8b2-4982-4f89-a355-066899c11463 (e840c8b2-4982-4f89-a355-066899c11463): created successfully Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b166c8-5798-4ea0-8fd9-19c5222de75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (d161288e-1102-4975-ab6f-66fa34669535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:13 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5b4ecad9-a399-434c-85ac-836b7b8fa9b7 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created volume successfully. Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (71200d8d-faf2-4b10-9f8a-e817bb9a17b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6c34c2-447d-4e5f-bcc9-683e9a50d936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d6c34c2-447d-4e5f-bcc9-683e9a50d936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184171592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ff8dd9-814c-49eb-85d4-f092d077e88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:13Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003b5634-d559-47d7-ab17-478938726e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003b5634-d559-47d7-ab17-478938726e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ac1aae-0eb8-4954-979a-8f2f3581eb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ac1aae-0eb8-4954-979a-8f2f3581eb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ff8dd9-814c-49eb-85d4-f092d077e88c', 'volume_name': 'volume-20ff8dd9-814c-49eb-85d4-f092d077e88c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b67f3b6-14ba-4400-9701-36cecf3acdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b67f3b6-14ba-4400-9701-36cecf3acdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124e0199-3efe-4c47-9857-f1cb682c430a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume 20ff8dd9-814c-49eb-85d4-f092d077e88c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ff8dd9-814c-49eb-85d4-f092d077e88c', 'volume_size': 1} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:13 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e 1073741824" returned: 0 in 0.562s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:13 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e Sep 01 02:21:13 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (bfc74d24-6d32-41dd-a329-6e85ffe49d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0196ad-054c-4fdf-89f8-f31dd66c9c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a0196ad-054c-4fdf-89f8-f31dd66c9c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1774479019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce44d52a-f3f3-4485-8682-f33a75abfd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:14Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af725b2-dc29-4395-ad93-a4264fa5c6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4af725b2-dc29-4395-ad93-a4264fa5c6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d56be28-2a1a-4d18-89a8-050497d7f49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d56be28-2a1a-4d18-89a8-050497d7f49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce44d52a-f3f3-4485-8682-f33a75abfd40', 'volume_name': 'volume-ce44d52a-f3f3-4485-8682-f33a75abfd40', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4c1ba3-f623-4c25-90d7-89c26e5de828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4c1ba3-f623-4c25-90d7-89c26e5de828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b99bb6-e0e0-40c3-9beb-ce3ef772ca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume ce44d52a-f3f3-4485-8682-f33a75abfd40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce44d52a-f3f3-4485-8682-f33a75abfd40', 'volume_size': 1} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:13 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e" returned: 0 in 0.259s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.964s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-276131835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3feb7b00-644a-4cbe-8d3a-80cee714d0c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:13Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Creating volume 3feb7b00-644a-4cbe-8d3a-80cee714d0c9 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:13 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c300735-16d2-41e4-9e5c-6b1a35a86c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddaaaf77-20d6-4498-998c-75e60c806d5e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2963a570-3582-4a70-a892-6e02d1a9bdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:13 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9 1073741824 Sep 01 02:21:13 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:13 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume volume-ddaaaf77-20d6-4498-998c-75e60c806d5e (ddaaaf77-20d6-4498-998c-75e60c806d5e): created successfully Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2963a570-3582-4a70-a892-6e02d1a9bdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (76ba5e32-0713-414f-a745-4ed442013d56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:13 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d26b0066-fc14-4aa7-ba07-a14b10deb65f tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created volume successfully. Sep 01 02:21:14 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9 1073741824" returned: 0 in 0.431s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:14 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9 Sep 01 02:21:14 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:14 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9" returned: 0 in 0.282s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.291s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1184171592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ff8dd9-814c-49eb-85d4-f092d077e88c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:13Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Creating volume 20ff8dd9-814c-49eb-85d4-f092d077e88c {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:14 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:14 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c 1073741824 Sep 01 02:21:14 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb8ffdb-c6bc-479a-917c-8bd866c5c8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6bb36b-a3c0-4e0f-98f8-286cbab8c4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:14 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9 (3feb7b00-644a-4cbe-8d3a-80cee714d0c9): created successfully Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6bb36b-a3c0-4e0f-98f8-286cbab8c4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (b26562cd-65c3-4245-aaab-25b88f2f6f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2d817387-38c7-4e37-8fe4-b5bd9c2fe8ae tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created volume successfully. Sep 01 02:21:15 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c 1073741824" returned: 0 in 0.426s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:15 devstack sudo[104704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c Sep 01 02:21:15 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:15 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c" returned: 0 in 0.249s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.610s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1774479019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce44d52a-f3f3-4485-8682-f33a75abfd40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d26499a562524d8e8ed99897c6229597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:14Z,use_quota=True,user_id='ee55fb9c8c794786a90684c77b7d7f19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Creating volume ce44d52a-f3f3-4485-8682-f33a75abfd40 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:15 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124e0199-3efe-4c47-9857-f1cb682c430a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ff8dd9-814c-49eb-85d4-f092d077e88c', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:15 devstack sudo[104707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40 1073741824 Sep 01 02:21:15 devstack sudo[104707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5930c9f-5477-4c45-b553-a787abfd8e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:15 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume volume-20ff8dd9-814c-49eb-85d4-f092d077e88c (20ff8dd9-814c-49eb-85d4-f092d077e88c): created successfully Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5930c9f-5477-4c45-b553-a787abfd8e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (71200d8d-faf2-4b10-9f8a-e817bb9a17b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:15 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4eabc375-a476-4b8c-b128-69760cf9b7a1 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created volume successfully. Sep 01 02:21:15 devstack sudo[104707]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40 1073741824" returned: 0 in 0.461s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:15 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40 Sep 01 02:21:15 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:16 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b99bb6-e0e0-40c3-9beb-ce3ef772ca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce44d52a-f3f3-4485-8682-f33a75abfd40', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a38585-45b6-48f2-b184-de789ed1d9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:16 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Volume volume-ce44d52a-f3f3-4485-8682-f33a75abfd40 (ce44d52a-f3f3-4485-8682-f33a75abfd40): created successfully Sep 01 02:21:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a38585-45b6-48f2-b184-de789ed1d9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Flow 'volume_create_manager' (bfc74d24-6d32-41dd-a329-6e85ffe49d32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:16 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0e3e2f8d-443b-4098-aa88-e006ba824a97 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created volume successfully. Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-ce44d52a-f3f3-4485-8682-f33a75abfd40-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-ce44d52a-f3f3-4485-8682-f33a75abfd40-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-quobyte-ce44d52a-f3f3-4485-8682-f33a75abfd40" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-ce44d52a-f3f3-4485-8682-f33a75abfd40" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6b1e51-873d-440c-b2f7-d10ab12913b6]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:17 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40 Sep 01 02:21:17 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:17 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40" returned: 0 in 0.357s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:17 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40 Sep 01 02:21:17 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:17 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ce44d52a-f3f3-4485-8682-f33a75abfd40" returned: 0 in 0.266s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-ce44d52a-f3f3-4485-8682-f33a75abfd40" released by "delete_volume" :: held 0.659s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created reservations ['e3a54e03-4488-4ff6-a458-822fab563a38', '205505c9-1a60-4ba1-9b8f-3af3118e46de', '8707ce3e-f645-4452-b81f-8098b0b9c8af', 'a7dd0953-e90a-459e-a4fc-f3f081c67b05'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:17 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:17 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:18 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.240s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:18 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Deleted volume successfully. Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a75568f-219c-48e8-86df-88ad40990b14 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-ce44d52a-f3f3-4485-8682-f33a75abfd40-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-20ff8dd9-814c-49eb-85d4-f092d077e88c-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-20ff8dd9-814c-49eb-85d4-f092d077e88c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-quobyte-20ff8dd9-814c-49eb-85d4-f092d077e88c" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-20ff8dd9-814c-49eb-85d4-f092d077e88c" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbc1946-5583-4976-b4d2-3b63786c9069]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:18 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c Sep 01 02:21:18 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:18 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c" returned: 0 in 0.365s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:18 devstack sudo[104738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c Sep 01 02:21:18 devstack sudo[104738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:18 devstack sudo[104738]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-20ff8dd9-814c-49eb-85d4-f092d077e88c" returned: 0 in 0.270s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-20ff8dd9-814c-49eb-85d4-f092d077e88c" released by "delete_volume" :: held 0.669s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created reservations ['a83ebf0b-58ab-454f-9788-8dc966de2d15', '5c614dbb-f6c0-4cf6-9cc8-6f040d03a16d', '653d8e0e-351a-4cf6-94e3-5eac6e67e5f2', '9271056e-93c7-4cee-bb4d-2420c82c12fc'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=56,cinder:UPDATE=65,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=72,cinder:UPDATE=63,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:19 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:19 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:19 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.255s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Deleted volume successfully. Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e65b1e74-dedb-4bd9-8145-5eb5a67dd588 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-20ff8dd9-814c-49eb-85d4-f092d077e88c-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-3feb7b00-644a-4cbe-8d3a-80cee714d0c9-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-3feb7b00-644a-4cbe-8d3a-80cee714d0c9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-quobyte-3feb7b00-644a-4cbe-8d3a-80cee714d0c9" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-3feb7b00-644a-4cbe-8d3a-80cee714d0c9" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[057c8536-35b4-48b1-a49a-7bec51566a4b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:19 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9 Sep 01 02:21:19 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:19 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9" returned: 0 in 0.342s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:19 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9 Sep 01 02:21:19 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:20 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-3feb7b00-644a-4cbe-8d3a-80cee714d0c9" returned: 0 in 0.244s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-3feb7b00-644a-4cbe-8d3a-80cee714d0c9" released by "delete_volume" :: held 0.631s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created reservations ['6788cc52-699c-4f2a-ac6e-b598dc161f40', '14277e1c-985d-4967-8ce6-27145110897d', 'babba268-a2d2-434e-abd0-7c68a1b01aa7', '7047ebbd-5cfc-47f0-8a08-33f02205bd2a'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:20 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:20 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:20 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.250s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Deleted volume successfully. Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-649349eb-398e-4892-a9d8-d05bfcbdb9e9 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-3feb7b00-644a-4cbe-8d3a-80cee714d0c9-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-ddaaaf77-20d6-4498-998c-75e60c806d5e-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-ddaaaf77-20d6-4498-998c-75e60c806d5e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-quobyte-ddaaaf77-20d6-4498-998c-75e60c806d5e" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-ddaaaf77-20d6-4498-998c-75e60c806d5e" acquired by "delete_volume" :: waited 0.013s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca1db90-66fd-49a1-bd00-5c706f2696d2]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:20 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e Sep 01 02:21:20 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:20 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e" returned: 0 in 0.365s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:21 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e Sep 01 02:21:21 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:21 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ddaaaf77-20d6-4498-998c-75e60c806d5e" returned: 0 in 0.236s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-ddaaaf77-20d6-4498-998c-75e60c806d5e" released by "delete_volume" :: held 0.642s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created reservations ['025629a2-ac9d-4c8b-b359-6fd64a24c73d', 'c27dfb78-7bbb-43cf-a5b7-0b4c9ef943b8', '9cd594af-f86e-4f86-913e-57cba7663ba0', '5c07c227-09bc-4297-9954-e178bf77b4a3'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:21 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:21 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:21 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.245s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Deleted volume successfully. Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-e840c8b2-4982-4f89-a355-066899c11463-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8e54035d-4b5a-4a73-8d4d-266373a3fb5b tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-ddaaaf77-20d6-4498-998c-75e60c806d5e-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-e840c8b2-4982-4f89-a355-066899c11463-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-quobyte-e840c8b2-4982-4f89-a355-066899c11463" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-e840c8b2-4982-4f89-a355-066899c11463" acquired by "delete_volume" :: waited 0.014s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0297d6b-fcd2-4082-bb83-4750d4d40f6a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:21 devstack sudo[104768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463 Sep 01 02:21:21 devstack sudo[104768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:22 devstack sudo[104768]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463" returned: 0 in 0.353s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:22 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463 Sep 01 02:21:22 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:22 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e840c8b2-4982-4f89-a355-066899c11463" returned: 0 in 0.234s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-e840c8b2-4982-4f89-a355-066899c11463" released by "delete_volume" :: held 0.625s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created reservations ['6b72933f-4b5a-4602-bf97-2272693d89de', 'c3fc2673-c1ad-4bf4-96a7-081d2ae3e2e9', 'db0f783c-fa93-4dbc-b74a-e85f10944c26', '67360e4d-5058-4559-8cb7-b9710fcdb93d'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:22 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:22 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:22 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.243s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:22 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Deleted volume successfully. Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b8762b8c-24b3-4cf3-8341-f301eaeabf3d tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-e840c8b2-4982-4f89-a355-066899c11463-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-d8241080-cf5c-49d9-b07d-74342b8caf08-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-d8241080-cf5c-49d9-b07d-74342b8caf08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-quobyte-ebd0e66e-7eb4-4a7d-96af-b754b630b34f" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-ebd0e66e-7eb4-4a7d-96af-b754b630b34f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-quobyte-d8241080-cf5c-49d9-b07d-74342b8caf08" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-d8241080-cf5c-49d9-b07d-74342b8caf08" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Deleting offline snapshot d8241080-cf5c-49d9-b07d-74342b8caf08 of volume ebd0e66e-7eb4-4a7d-96af-b754b630b34f {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] snapshot_file for this snap is: volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[325505c0-9fc0-4ba5-8302-491f2b0570ce]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:23 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 Sep 01 02:21:23 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:23 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08" returned: 0 in 0.349s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:23 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:23 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[731a078f-72af-4060-97c4-74d966c3b8fe]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:23 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f Sep 01 02:21:23 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:23 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f" returned: 0 in 0.359s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:23 devstack sudo[104791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 Sep 01 02:21:23 devstack sudo[104791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:24 devstack sudo[104791]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08" returned: 0 in 0.353s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:24 devstack sudo[104797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08 Sep 01 02:21:24 devstack sudo[104797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:24 devstack sudo[104797]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f.d8241080-cf5c-49d9-b07d-74342b8caf08" returned: 0 in 0.260s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-d8241080-cf5c-49d9-b07d-74342b8caf08" released by "_delete_snapshot" :: held 1.418s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-ebd0e66e-7eb4-4a7d-96af-b754b630b34f" released by "delete_snapshot" :: held 1.441s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:24 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created reservations ['5d412a1b-f1a9-45cb-829d-2d6a594a1849', 'c4f071fc-673f-4aa8-bcc6-1f8fa2facf08', 'd57c54d8-63be-444f-b8f8-1355bffde302', '554a05a6-31a3-42bd-99cd-78b84ba35d04'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:24 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Delete snapshot completed successfully. Sep 01 02:21:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4762e3ac-5344-40ef-8f5c-937562f121bc tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-d8241080-cf5c-49d9-b07d-74342b8caf08-delete_snapshot" released by "delete_snapshot" :: held 1.578s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-ebd0e66e-7eb4-4a7d-96af-b754b630b34f-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-ebd0e66e-7eb4-4a7d-96af-b754b630b34f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "cinder-quobyte-ebd0e66e-7eb4-4a7d-96af-b754b630b34f" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-ebd0e66e-7eb4-4a7d-96af-b754b630b34f" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4340ff39-30c1-4ff7-8671-b2e2301ade99]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:25 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f Sep 01 02:21:25 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:25 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f" returned: 0 in 0.372s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:25 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f Sep 01 02:21:25 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:25 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ebd0e66e-7eb4-4a7d-96af-b754b630b34f" returned: 0 in 0.275s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-quobyte-ebd0e66e-7eb4-4a7d-96af-b754b630b34f" released by "delete_volume" :: held 0.704s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Created reservations ['032ad501-a5d0-433e-991b-7f5031d4d6cf', '9ac30927-eaf0-40e0-b335-09c924e23351', 'b4f29e40-30d0-481f-8930-c6dcf378e91a', 'fc6749fd-d862-4905-9380-3ffad57e09e7'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:25 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:25 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:26 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.267s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:26 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:26 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Deleted volume successfully. Sep 01 02:21:26 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-498fc199-0a4d-4c92-9da6-dc23c05c1aa4 tempest-CreateVolumesFromSnapshotTest-2018515520 None] Lock "cinder-ebd0e66e-7eb4-4a7d-96af-b754b630b34f-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:35 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=37,cinder:DELETE=2 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:21:36 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=45,cinder:DELETE=3,cinder:SELECT=27,cinder:INSERT=10 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (f548a2d9-ff0e-46c5-bbc2-d940fd45db61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5af8c1-576d-49ce-8e0c-84465d5e7f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f5af8c1-576d-49ce-8e0c-84465d5e7f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-242946286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f189d6-7f04-4f37-b3cc-9904e6ea97a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:39Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6ea59a-a499-4ebc-bc67-d572e2b647cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6ea59a-a499-4ebc-bc67-d572e2b647cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11757c0-9790-41b3-ada1-eab4a14af7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11757c0-9790-41b3-ada1-eab4a14af7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f189d6-7f04-4f37-b3cc-9904e6ea97a5', 'volume_name': 'volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779101aa-34b7-47b9-912e-9b2fc5a23bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779101aa-34b7-47b9-912e-9b2fc5a23bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9233209-15ae-4a54-a3b7-28a12c325e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume 58f189d6-7f04-4f37-b3cc-9904e6ea97a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5', 'volume_size': 1} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-242946286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f189d6-7f04-4f37-b3cc-9904e6ea97a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:39Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Creating volume 58f189d6-7f04-4f37-b3cc-9904e6ea97a5 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:39 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:39 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5 1073741824 Sep 01 02:21:39 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Flow 'volume_create_manager' (7bf132d5-e3ea-47a5-a38b-93b2a741fdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1be241-df18-4836-9f44-a7f6bcfe4f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b1be241-df18-4836-9f44-a7f6bcfe4f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-437090152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad46f612-ff03-41fb-98bd-46e0c12506be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e22ce968964338be7974c42e7908d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:40Z,use_quota=True,user_id='c0b9356408e448479b550fa35b59791d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f55deae-ebb6-48a2-b9d7-9192e77b8420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f55deae-ebb6-48a2-b9d7-9192e77b8420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ff8a84-a36a-4a3d-9f01-bfd84f28e6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ff8a84-a36a-4a3d-9f01-bfd84f28e6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad46f612-ff03-41fb-98bd-46e0c12506be', 'volume_name': 'volume-ad46f612-ff03-41fb-98bd-46e0c12506be', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a5c1e0-3325-434c-8296-0e3fc7b8b6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0a5c1e0-3325-434c-8296-0e3fc7b8b6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440f4e8e-aa99-49b6-a8ec-143ea794a98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Volume ad46f612-ff03-41fb-98bd-46e0c12506be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad46f612-ff03-41fb-98bd-46e0c12506be', 'volume_size': 1} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Flow 'volume_create_manager' (971c4176-8c73-4d35-bf40-1592ae3acf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0828d355-2975-484d-8c7d-4e5d820bfd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0828d355-2975-484d-8c7d-4e5d820bfd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1408492747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bf5a5d-8f7a-4cad-884c-06930d408a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e22ce968964338be7974c42e7908d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:40Z,use_quota=True,user_id='c0b9356408e448479b550fa35b59791d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75303931-adfc-41ac-ae65-8fc12c94d0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75303931-adfc-41ac-ae65-8fc12c94d0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a84546f-363e-45ac-87b2-2ec977c70a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a84546f-363e-45ac-87b2-2ec977c70a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6bf5a5d-8f7a-4cad-884c-06930d408a8a', 'volume_name': 'volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af007c2-2980-45f5-99eb-95a16f9f47b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af007c2-2980-45f5-99eb-95a16f9f47b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae641be-bac4-44cb-b194-b4b7046b3c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:40 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Volume e6bf5a5d-8f7a-4cad-884c-06930d408a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a', 'volume_size': 1} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:40 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5 1073741824" returned: 0 in 0.704s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:40 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5 Sep 01 02:21:40 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Flow 'volume_create_manager' (4433e3cd-0917-4616-8574-2ad84b78d6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:40 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d78ad3-c4d6-483d-a813-5c00cd96f26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5" returned: 0 in 0.426s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.821s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-437090152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad46f612-ff03-41fb-98bd-46e0c12506be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e22ce968964338be7974c42e7908d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:40Z,use_quota=True,user_id='c0b9356408e448479b550fa35b59791d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Creating volume ad46f612-ff03-41fb-98bd-46e0c12506be {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:40 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1d78ad3-c4d6-483d-a813-5c00cd96f26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1610502789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e22ce968964338be7974c42e7908d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:40Z,use_quota=True,user_id='c0b9356408e448479b550fa35b59791d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8d0763-d981-42fa-9371-cff628c8a285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:40 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be 1073741824 Sep 01 02:21:40 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8d0763-d981-42fa-9371-cff628c8a285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708ecfe9-88cd-4156-99b7-6ba1690b734e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (708ecfe9-88cd-4156-99b7-6ba1690b734e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372', 'volume_name': 'volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ad32ff-9f63-4973-b64c-306661b8bbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ad32ff-9f63-4973-b64c-306661b8bbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b31a127-8a7f-4093-9dd1-39055b24d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:40 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Volume 7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372', 'volume_size': 1} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9233209-15ae-4a54-a3b7-28a12c325e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bcb35b-7ed3-4f72-b873-854c79a44fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Flow 'volume_create_manager' (6546556b-df04-43f3-981d-a3c23c4e2cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c974fdb-cd08-433b-acb7-456fc6787a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:40 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5 (58f189d6-7f04-4f37-b3cc-9904e6ea97a5): created successfully Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79bcb35b-7ed3-4f72-b873-854c79a44fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (f548a2d9-ff0e-46c5-bbc2-d940fd45db61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c974fdb-cd08-433b-acb7-456fc6787a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-979118758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbbe888-88ac-488b-bc54-52b59ddf00b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99ab6ba271c403ea713b17a4ad74a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:41Z,use_quota=True,user_id='191ebe85970840cabaef4f660db8c444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0fa744-e8b4-46b7-a129-98063a6a9dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0fa744-e8b4-46b7-a129-98063a6a9dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5486d103-a326-473e-97ca-0b4edeb048d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5486d103-a326-473e-97ca-0b4edeb048d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bbbe888-88ac-488b-bc54-52b59ddf00b6', 'volume_name': 'volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea9bb56-1c87-454e-81df-055dd53ee4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ea9bb56-1c87-454e-81df-055dd53ee4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1171b76c-c060-4fc9-b375-2c95c8c13edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Volume 8bbbe888-88ac-488b-bc54-52b59ddf00b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6', 'volume_size': 1} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f6bc2d53-7db2-4a5a-a629-568627254189 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created volume successfully. Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Flow 'volume_create_manager' (6743c0f7-cd66-4992-9d8b-d12896b53952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf18c06-67bb-4509-9c17-5987a60947e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf18c06-67bb-4509-9c17-5987a60947e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2109388751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425a6c5f-2f41-4bb3-b2ba-e32fe667169f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e22ce968964338be7974c42e7908d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:41Z,use_quota=True,user_id='c0b9356408e448479b550fa35b59791d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79522f9-8e05-4aaa-987b-d6aa20a27418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79522f9-8e05-4aaa-987b-d6aa20a27418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92851b92-0684-4dd9-8835-b8383f0da0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92851b92-0684-4dd9-8835-b8383f0da0b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425a6c5f-2f41-4bb3-b2ba-e32fe667169f', 'volume_name': 'volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b42f2f-fad6-4454-b447-a34d65303493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4b42f2f-fad6-4454-b447-a34d65303493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605fc1e9-0a48-4242-b035-d76a16354e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Volume 425a6c5f-2f41-4bb3-b2ba-e32fe667169f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f', 'volume_size': 1} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Flow 'volume_create_manager' (e1a97094-77a3-4a2b-8a25-633bfd0e7728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c097ea2-bf10-4aae-89c2-e4e632831f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c097ea2-bf10-4aae-89c2-e4e632831f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899890648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920e11c9-861c-4639-8b31-d63ecff5c5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e22ce968964338be7974c42e7908d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:41Z,use_quota=True,user_id='c0b9356408e448479b550fa35b59791d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d13fe38-e2e1-4da2-97ec-6e6fd5ffe732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d13fe38-e2e1-4da2-97ec-6e6fd5ffe732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e351c78b-0f08-4048-9326-5a6cf8871a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e351c78b-0f08-4048-9326-5a6cf8871a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '920e11c9-861c-4639-8b31-d63ecff5c5ed', 'volume_name': 'volume-920e11c9-861c-4639-8b31-d63ecff5c5ed', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d07d25-5eaa-459f-b271-7536994a8f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8d07d25-5eaa-459f-b271-7536994a8f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ae808e-7444-45fe-89f3-df19fc8ee2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Volume 920e11c9-861c-4639-8b31-d63ecff5c5ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-920e11c9-861c-4639-8b31-d63ecff5c5ed', 'volume_size': 1} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:41 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be 1073741824" returned: 0 in 0.804s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:41 devstack sudo[104902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be Sep 01 02:21:41 devstack sudo[104902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:41 devstack sudo[104902]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be" returned: 0 in 0.296s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.835s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1408492747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6bf5a5d-8f7a-4cad-884c-06930d408a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e22ce968964338be7974c42e7908d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:40Z,use_quota=True,user_id='c0b9356408e448479b550fa35b59791d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Creating volume e6bf5a5d-8f7a-4cad-884c-06930d408a8a {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:41 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440f4e8e-aa99-49b6-a8ec-143ea794a98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad46f612-ff03-41fb-98bd-46e0c12506be', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585d758a-5e3a-4bd4-9160-263b15c0cb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:41 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a 1073741824 Sep 01 02:21:41 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:41 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Volume volume-ad46f612-ff03-41fb-98bd-46e0c12506be (ad46f612-ff03-41fb-98bd-46e0c12506be): created successfully Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (585d758a-5e3a-4bd4-9160-263b15c0cb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Flow 'volume_create_manager' (7bf132d5-e3ea-47a5-a38b-93b2a741fdcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c84ca12c-e006-4394-8d9d-2eb8aeaceefb tempest-CreateVolumesFromImageTest-2016819546 None] Created volume successfully. Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (20598a3d-4303-4380-b07a-87041603cff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72da510a-2889-4a26-ad73-218e2e6ddd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72da510a-2889-4a26-ad73-218e2e6ddd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2002692195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f39f77-b357-4121-8924-4ef66f2a4253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:42Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe54b0fa-e87c-4fd0-837b-10e063428e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe54b0fa-e87c-4fd0-837b-10e063428e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153ecb0e-10ed-4cde-a038-2c77ea03c115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (153ecb0e-10ed-4cde-a038-2c77ea03c115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98f39f77-b357-4121-8924-4ef66f2a4253', 'volume_name': 'volume-98f39f77-b357-4121-8924-4ef66f2a4253', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d132991-96b8-4f7d-9da8-6f64446d276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d132991-96b8-4f7d-9da8-6f64446d276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecf1cc1-b4f7-4a6c-9f3a-5b8024e380f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:42 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume 98f39f77-b357-4121-8924-4ef66f2a4253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98f39f77-b357-4121-8924-4ef66f2a4253', 'volume_size': 1} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:42 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a 1073741824" returned: 0 in 0.710s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (de15edf9-c31e-42f1-9b49-6503b9658032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d450b844-cf81-4791-a6f9-55fcab3b568c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d450b844-cf81-4791-a6f9-55fcab3b568c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794664684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d8469d-5a75-47b8-8c2e-535f5d18271d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:43Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f0b279-a7b2-442f-ba9e-ff2fe663bb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:42 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a Sep 01 02:21:42 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67f0b279-a7b2-442f-ba9e-ff2fe663bb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142bdd71-f2d6-4f6e-87a7-7f955b8c8c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142bdd71-f2d6-4f6e-87a7-7f955b8c8c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d8469d-5a75-47b8-8c2e-535f5d18271d', 'volume_name': 'volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8206afe6-a62b-4451-9a7c-36327d3bf236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8206afe6-a62b-4451-9a7c-36327d3bf236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b35252-44f8-465a-8b33-0557b887e5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:42 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume d9d8469d-5a75-47b8-8c2e-535f5d18271d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d', 'volume_size': 1} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:42 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a" returned: 0 in 0.286s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.156s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1610502789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e22ce968964338be7974c42e7908d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:40Z,use_quota=True,user_id='c0b9356408e448479b550fa35b59791d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Creating volume 7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:42 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:42 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae641be-bac4-44cb-b194-b4b7046b3c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643f5496-0241-486a-86cf-eb94fe10e28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:43 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372 1073741824 Sep 01 02:21:43 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:43 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Volume volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a (e6bf5a5d-8f7a-4cad-884c-06930d408a8a): created successfully Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643f5496-0241-486a-86cf-eb94fe10e28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Flow 'volume_create_manager' (971c4176-8c73-4d35-bf40-1592ae3acf9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (18f2d639-20c3-44fe-9ecc-4db4b28a686b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1e67d2-20a3-41bb-97ec-e24816616935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:43 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1aafaf05-2b8b-4306-8f96-4727aaef2a7a tempest-CreateVolumesFromImageTest-2016819546 None] Created volume successfully. Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1e67d2-20a3-41bb-97ec-e24816616935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1868544977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0861739-2370-49cd-aecc-205c748c9bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:43Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea2701e-ff2d-4eab-ae6e-44ce1e7c172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fea2701e-ff2d-4eab-ae6e-44ce1e7c172a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ac8c2b-bca1-4756-83e6-ebabf4b3ed15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ac8c2b-bca1-4756-83e6-ebabf4b3ed15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0861739-2370-49cd-aecc-205c748c9bc6', 'volume_name': 'volume-f0861739-2370-49cd-aecc-205c748c9bc6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3086beee-fd0d-4c8d-945e-c03567f47edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3086beee-fd0d-4c8d-945e-c03567f47edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd99d0be-7d91-4919-a26b-f6e534fd0323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:43 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume f0861739-2370-49cd-aecc-205c748c9bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0861739-2370-49cd-aecc-205c748c9bc6', 'volume_size': 1} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (46244345-1f3f-489c-b16a-93eb47e93e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a64a06-87a4-4993-a7a4-381f0eff59aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a64a06-87a4-4993-a7a4-381f0eff59aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2088583562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:43Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5312c2b7-324d-4289-a0e5-760069c46820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5312c2b7-324d-4289-a0e5-760069c46820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:43 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e91b84b-fbf7-4659-8148-cb04ab451884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e91b84b-fbf7-4659-8148-cb04ab451884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1', 'volume_name': 'volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e270e002-abe1-40e3-9f87-12f3824c0dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e270e002-abe1-40e3-9f87-12f3824c0dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75206b5-c3aa-4134-ae43-83550665e606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:43 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1', 'volume_size': 1} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372 1073741824" returned: 0 in 0.730s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:43 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372 Sep 01 02:21:43 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (d5744f74-c104-467d-9458-b98da78b567a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:44 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f71266a-d7c1-4e77-a9cd-fae85338aa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372" returned: 0 in 0.324s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] <== create_volume: return (1106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.967s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-979118758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bbbe888-88ac-488b-bc54-52b59ddf00b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99ab6ba271c403ea713b17a4ad74a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:41Z,use_quota=True,user_id='191ebe85970840cabaef4f660db8c444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Creating volume 8bbbe888-88ac-488b-bc54-52b59ddf00b6 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:44 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f71266a-d7c1-4e77-a9cd-fae85338aa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513769624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9607552-0d1d-4532-92ed-9f75a5791959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:44Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 1073741824 Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8001587d-bc1c-4106-9439-11f18bd8e40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8001587d-bc1c-4106-9439-11f18bd8e40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50259de1-018b-4b2d-9d53-ced7501968e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50259de1-018b-4b2d-9d53-ced7501968e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9607552-0d1d-4532-92ed-9f75a5791959', 'volume_name': 'volume-d9607552-0d1d-4532-92ed-9f75a5791959', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8b8237-3096-41b8-a199-315f018a1129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8b8237-3096-41b8-a199-315f018a1129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9955255b-557d-4c8f-9d6c-36f4d0c4ff73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume d9607552-0d1d-4532-92ed-9f75a5791959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9607552-0d1d-4532-92ed-9f75a5791959', 'volume_size': 1} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b31a127-8a7f-4093-9dd1-39055b24d25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b541d459-1a0a-4866-8bf8-8c2082c5ff84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Volume volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372 (7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372): created successfully Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b541d459-1a0a-4866-8bf8-8c2082c5ff84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Flow 'volume_create_manager' (4433e3cd-0917-4616-8574-2ad84b78d6cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:44 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c3407725-990f-42da-bab5-4ca4b472851b tempest-CreateVolumesFromImageTest-2016819546 None] Created volume successfully. Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Flow 'volume_create_manager' (849e1bce-2923-4b1a-90e5-01527ab9950b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd20416-137f-4cc1-abb0-ca40ce344ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cd20416-137f-4cc1-abb0-ca40ce344ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5aa990-8bbe-4d28-a640-7aedd856288c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06011d76d42749df82abbfe1a42e079a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:44Z,use_quota=True,user_id='d54ee698908248dba4a20830cfc8321b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5e170af-6582-4bff-8565-b6acca0acf6a),volume_type_id=d5e170af-6582-4bff-8565-b6acca0acf6a)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11920d74-09b6-4690-b1ab-b25b6ff17b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11920d74-09b6-4690-b1ab-b25b6ff17b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e821ba4d-b8de-4176-af0f-129feae46059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.image.glance [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Creating Keystone auth plugin from conf {{(pid=87389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:21:44 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 1073741824" returned: 0 in 0.531s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:44 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 Sep 01 02:21:44 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e821ba4d-b8de-4176-af0f-129feae46059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de5aa990-8bbe-4d28-a640-7aedd856288c', 'volume_name': 'volume-de5aa990-8bbe-4d28-a640-7aedd856288c', 'volume_size': 1, 'image_id': '8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '548bad2866d6724e05646ea3056deca3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06011d76d42749df82abbfe1a42e079a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25b99aeb59b278f399b7d740a9c05435c75cb008f5dcf709c7b39726f8f4583d178fcb42bfd0fde81d3f8525df3d747bcba2e9a4c84df4fef0e0d46d3517303d', 'id': '8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'created_at': datetime.datetime(2026, 9, 1, 0, 21, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 21, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f173987f-7ac7-48ab-9769-8da37ba3777a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f173987f-7ac7-48ab-9769-8da37ba3777a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f66b71d-362a-472e-bd98-408d3b94885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Volume de5aa990-8bbe-4d28-a640-7aedd856288c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de5aa990-8bbe-4d28-a640-7aedd856288c', 'volume_size': 1, 'image_id': '8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '548bad2866d6724e05646ea3056deca3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06011d76d42749df82abbfe1a42e079a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25b99aeb59b278f399b7d740a9c05435c75cb008f5dcf709c7b39726f8f4583d178fcb42bfd0fde81d3f8525df3d747bcba2e9a4c84df4fef0e0d46d3517303d', 'id': '8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'created_at': datetime.datetime(2026, 9, 1, 0, 21, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 21, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Trying to clone de5aa990-8bbe-4d28-a640-7aedd856288c from image 8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f at location (None, [{'url': 'file:///opt/stack/data/glance/images/8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'metadata': {}}]). {{(pid=87389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:21:44 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36d7884-ecd8-46e8-ab89-c858425de27d]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:44 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6" returned: 0 in 0.259s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.685s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2109388751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425a6c5f-2f41-4bb3-b2ba-e32fe667169f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e22ce968964338be7974c42e7908d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:41Z,use_quota=True,user_id='c0b9356408e448479b550fa35b59791d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Creating volume 425a6c5f-2f41-4bb3-b2ba-e32fe667169f {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:44 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1171b76c-c060-4fc9-b375-2c95c8c13edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f 1073741824 Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6771c5-b229-4d71-a7f4-e829a46bde2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:44 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:44 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Volume volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 (8bbbe888-88ac-488b-bc54-52b59ddf00b6): created successfully Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e6771c5-b229-4d71-a7f4-e829a46bde2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:44 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Flow 'volume_create_manager' (6546556b-df04-43f3-981d-a3c23c4e2cc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:44 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7a405e55-02ee-49c2-8be7-434de85bbea6 tempest-VolumeDependencyTests-1116740684 None] Created volume successfully. Sep 01 02:21:44 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD Sep 01 02:21:45 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:45 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:45 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD Sep 01 02:21:45 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:45 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f 1073741824" returned: 0 in 0.474s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:45 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f Sep 01 02:21:45 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:45 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Temporary image 8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f is fetched for user d54ee698908248dba4a20830cfc8321b. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4add14d-c1d4-475d-84e7-1d93cae2b5ca]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:45 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f" returned: 0 in 0.281s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.363s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-899890648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=920e11c9-861c-4639-8b31-d63ecff5c5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2e22ce968964338be7974c42e7908d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:41Z,use_quota=True,user_id='c0b9356408e448479b550fa35b59791d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Creating volume 920e11c9-861c-4639-8b31-d63ecff5c5ed {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:45 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:45 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed 1073741824 Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605fc1e9-0a48-4242-b035-d76a16354e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:45 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc38db87-10c9-4d25-bce0-545d8ed843a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:45 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Volume volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f (425a6c5f-2f41-4bb3-b2ba-e32fe667169f): created successfully Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc38db87-10c9-4d25-bce0-545d8ed843a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Flow 'volume_create_manager' (6743c0f7-cd66-4992-9d8b-d12896b53952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:45 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8a66b019-9c74-437f-b801-0d7a1de75e21 tempest-CreateVolumesFromImageTest-2016819546 None] Created volume successfully. Sep 01 02:21:45 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD Sep 01 02:21:45 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:46 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:46 devstack sudo[104961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD Sep 01 02:21:46 devstack sudo[104961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:46 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed 1073741824" returned: 0 in 0.497s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:46 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed Sep 01 02:21:46 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:46 devstack sudo[104961]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:46 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed" returned: 0 in 0.275s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.379s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2002692195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f39f77-b357-4121-8924-4ef66f2a4253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:42Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Creating volume 98f39f77-b357-4121-8924-4ef66f2a4253 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:46 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ae808e-7444-45fe-89f3-df19fc8ee2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-920e11c9-861c-4639-8b31-d63ecff5c5ed', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:46 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253 1073741824 Sep 01 02:21:46 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839ae3eb-6518-4432-b729-0e83077d8acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:46 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Volume volume-920e11c9-861c-4639-8b31-d63ecff5c5ed (920e11c9-861c-4639-8b31-d63ecff5c5ed): created successfully Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (839ae3eb-6518-4432-b729-0e83077d8acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Flow 'volume_create_manager' (e1a97094-77a3-4a2b-8a25-633bfd0e7728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:46 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-51e2fa0b-581b-4f31-b617-199dd68d6087 tempest-CreateVolumesFromImageTest-2016819546 None] Created volume successfully. Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "cinder-920e11c9-861c-4639-8b31-d63ecff5c5ed-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-920e11c9-861c-4639-8b31-d63ecff5c5ed-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "cinder-quobyte-920e11c9-861c-4639-8b31-d63ecff5c5ed" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-quobyte-920e11c9-861c-4639-8b31-d63ecff5c5ed" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b9f359-dd14-48e8-b692-6b3d1aa76791]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:47 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253 1073741824" returned: 0 in 0.488s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:47 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed Sep 01 02:21:47 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:47 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253 Sep 01 02:21:47 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:47 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:47 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:47 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed" returned: 0 in 0.414s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:47 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253" returned: 0 in 0.294s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.655s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1794664684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d8469d-5a75-47b8-8c2e-535f5d18271d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:43Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Creating volume d9d8469d-5a75-47b8-8c2e-535f5d18271d {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:47 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:47 devstack sudo[104985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed Sep 01 02:21:47 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecf1cc1-b4f7-4a6c-9f3a-5b8024e380f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98f39f77-b357-4121-8924-4ef66f2a4253', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:47 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d 1073741824 Sep 01 02:21:47 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ebadb3-dc6b-43fe-b3c6-30252e1328e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:47 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume volume-98f39f77-b357-4121-8924-4ef66f2a4253 (98f39f77-b357-4121-8924-4ef66f2a4253): created successfully Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9ebadb3-dc6b-43fe-b3c6-30252e1328e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (20598a3d-4303-4380-b07a-87041603cff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:47 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bc135499-eaab-4dc7-abc9-2d9a0cff266f tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created volume successfully. Sep 01 02:21:47 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.369s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:21:47 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-920e11c9-861c-4639-8b31-d63ecff5c5ed" returned: 0 in 0.341s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-quobyte-920e11c9-861c-4639-8b31-d63ecff5c5ed" released by "delete_volume" :: held 0.803s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Created reservations ['20dff589-b150-4956-b72a-979d562b85f6', 'a6ce1115-65b5-4ae8-a8be-33768953b5c4', 'e3f5100d-3506-4eb6-b671-87d223cdb789', '7d4fea20-d4b0-4f30-be2e-6734ae76cd39'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:47 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:47 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:47 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d 1073741824" returned: 0 in 0.571s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "cinder-425a6c5f-2f41-4bb3-b2ba-e32fe667169f-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:48 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d Sep 01 02:21:48 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-425a6c5f-2f41-4bb3-b2ba-e32fe667169f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "cinder-quobyte-425a6c5f-2f41-4bb3-b2ba-e32fe667169f" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-quobyte-425a6c5f-2f41-4bb3-b2ba-e32fe667169f" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bab22d7-ff19-4f3f-a3a3-d24c8b688e1f]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:48 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.352s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Deleted volume successfully. Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d2419085-f670-4fd9-868f-29f9c8ecd245 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-920e11c9-861c-4639-8b31-d63ecff5c5ed-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:48 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f Sep 01 02:21:48 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:48 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d" returned: 0 in 0.357s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.132s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1868544977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0861739-2370-49cd-aecc-205c748c9bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:43Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Creating volume f0861739-2370-49cd-aecc-205c748c9bc6 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:48 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4b35252-44f8-465a-8b33-0557b887e5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:48 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6 1073741824 Sep 01 02:21:48 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6af05bd-86f3-4b1e-ad95-ba541abdb6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:48 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d (d9d8469d-5a75-47b8-8c2e-535f5d18271d): created successfully Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6af05bd-86f3-4b1e-ad95-ba541abdb6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (de15edf9-c31e-42f1-9b49-6503b9658032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3705a98e-20f3-4c14-b194-a771146eb231 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created volume successfully. Sep 01 02:21:48 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f" returned: 0 in 0.465s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:48 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f Sep 01 02:21:48 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:48 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6 1073741824" returned: 0 in 0.489s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:48 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6 Sep 01 02:21:48 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:48 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-425a6c5f-2f41-4bb3-b2ba-e32fe667169f" returned: 0 in 0.297s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-quobyte-425a6c5f-2f41-4bb3-b2ba-e32fe667169f" released by "delete_volume" :: held 0.819s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Created reservations ['b0e74003-289a-49c6-b661-482bf843ce50', '8b889a33-8db2-4bb9-97a6-edc0f0b0d630', '1991634d-f04a-48d9-9155-b15a57f41c87', '6c86c5d5-ad66-40e5-ba8d-5e626ff8d2de'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:49 devstack sudo[105016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:49 devstack sudo[105016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:49 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6" returned: 0 in 0.306s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.548s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2088583562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:43Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Creating volume b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:49 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "cinder-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:49 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1 1073741824 Sep 01 02:21:49 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd99d0be-7d91-4919-a26b-f6e534fd0323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0861739-2370-49cd-aecc-205c748c9bc6', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22003200-f89b-492e-b91c-b8ddea243c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:49 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume volume-f0861739-2370-49cd-aecc-205c748c9bc6 (f0861739-2370-49cd-aecc-205c748c9bc6): created successfully Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22003200-f89b-492e-b91c-b8ddea243c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (18f2d639-20c3-44fe-9ecc-4db4b28a686b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:49 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-096b0cd8-c319-49a0-8315-20f350890d0e tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created volume successfully. Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "cinder-quobyte-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-quobyte-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372" acquired by "delete_volume" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bc6a3a-6041-4de4-99e9-95347f2e9374]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:49 devstack sudo[105016]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.404s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:49 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Deleted volume successfully. Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cebad909-3867-4e33-93d8-d31b8c54852a tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-425a6c5f-2f41-4bb3-b2ba-e32fe667169f-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:49 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372 Sep 01 02:21:49 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:49 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1 1073741824" returned: 0 in 0.656s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:49 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372" returned: 0 in 0.477s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:49 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1 Sep 01 02:21:49 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:50 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372 Sep 01 02:21:50 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:50 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:50 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1" returned: 0 in 0.307s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.120s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-513769624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9607552-0d1d-4532-92ed-9f75a5791959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1ad28e22700444c98e7897aa19a65cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:44Z,use_quota=True,user_id='c6e57cc8b3ac4e5da1e0588604e37e9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Creating volume d9607552-0d1d-4532-92ed-9f75a5791959 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:50 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372" returned: 0 in 0.313s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:50 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959 1073741824 Sep 01 02:21:50 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b75206b5-c3aa-4134-ae43-83550665e606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53786166-a004-43b9-a315-20e188161e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-quobyte-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372" released by "delete_volume" :: held 0.888s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:50 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1 (b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1): created successfully Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53786166-a004-43b9-a315-20e188161e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (46244345-1f3f-489c-b16a-93eb47e93e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:50 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-67ba80e2-7297-464a-9cdf-c1f6f7930ed2 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created volume successfully. Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Created reservations ['f4d7fef6-2bbb-4afa-8c12-3a57b194e1f4', 'e9521cc0-e028-4cc9-aef4-c3055238c37b', 'efefbc28-c2f2-42fa-a092-21d4232c0520', '42a0a79c-1ccb-41d5-8686-e34406145a7b'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:50 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:50 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:50 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.284s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:50 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Deleted volume successfully. Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6a0a5afb-3b7a-4baa-8e45-c1bff354f52f tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-7b3ac0c6-4e1b-4b64-9d2b-81b2b47c3372-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:50 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959 1073741824" returned: 0 in 0.580s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:50 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959 Sep 01 02:21:50 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:51 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959" returned: 0 in 0.262s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.164s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9955255b-557d-4c8f-9d6c-36f4d0c4ff73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9607552-0d1d-4532-92ed-9f75a5791959', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ba0e7d-0c4e-462e-be4d-a16f7131bef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] Creating offline snapshot 1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d of volume 8bbbe888-88ac-488b-bc54-52b59ddf00b6 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:21:51 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Volume volume-d9607552-0d1d-4532-92ed-9f75a5791959 (d9607552-0d1d-4532-92ed-9f75a5791959): created successfully Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ba0e7d-0c4e-462e-be4d-a16f7131bef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Flow 'volume_create_manager' (d5744f74-c104-467d-9458-b98da78b567a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[342fbc35-b730-418a-8293-7cb5ac8c73d1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:51 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bed95bed-ac2f-4a83-b0b8-8bb3c90b220a tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created volume successfully. Sep 01 02:21:51 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 Sep 01 02:21:51 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "cinder-e6bf5a5d-8f7a-4cad-884c-06930d408a8a-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-e6bf5a5d-8f7a-4cad-884c-06930d408a8a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "cinder-quobyte-e6bf5a5d-8f7a-4cad-884c-06930d408a8a" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-quobyte-e6bf5a5d-8f7a-4cad-884c-06930d408a8a" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[701c14fc-3d5c-41cd-91f7-cf29f93c6942]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:51 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6" returned: 0 in 0.411s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:51 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d 1G Sep 01 02:21:51 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:51 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a Sep 01 02:21:51 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-d9607552-0d1d-4532-92ed-9f75a5791959-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-d9607552-0d1d-4532-92ed-9f75a5791959-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-quobyte-d9607552-0d1d-4532-92ed-9f75a5791959" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-d9607552-0d1d-4532-92ed-9f75a5791959" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d45d73-1806-4d10-99ed-183866dd433a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a" returned: 0 in 0.450s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a Sep 01 02:21:52 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:52 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959 Sep 01 02:21:52 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:52 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d 1G" returned: 0 in 0.504s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d Sep 01 02:21:52 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:52 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-e6bf5a5d-8f7a-4cad-884c-06930d408a8a" returned: 0 in 0.276s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-quobyte-e6bf5a5d-8f7a-4cad-884c-06930d408a8a" released by "delete_volume" :: held 0.774s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:52 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959" returned: 0 in 0.418s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack sudo[105078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959 Sep 01 02:21:52 devstack sudo[105078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Created reservations ['6a4468ac-80dd-40bc-bf75-bdec996021b5', '5de4fb12-334d-497d-ad2c-dc47049e8033', 'e129f34d-fa3c-4754-8f2d-c3b5b6580875', '15e4fbee-3d71-47c2-b774-42f2855c6684'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:52 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d" returned: 0 in 0.321s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d is being set with open permissions: ugo+rw Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d Sep 01 02:21:52 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:52 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "cinder-ad46f612-ff03-41fb-98bd-46e0c12506be-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:52 devstack sudo[105078]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9607552-0d1d-4532-92ed-9f75a5791959" returned: 0 in 0.302s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-d9607552-0d1d-4532-92ed-9f75a5791959" released by "delete_volume" :: held 0.781s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-ad46f612-ff03-41fb-98bd-46e0c12506be-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:52 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d" returned: 0 in 0.306s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "cinder-quobyte-ad46f612-ff03-41fb-98bd-46e0c12506be" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-quobyte-ad46f612-ff03-41fb-98bd-46e0c12506be" acquired by "delete_volume" :: waited 0.036s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:52 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[950adceb-e230-4ddb-a3d4-f1a322914367]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:52 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.info Sep 01 02:21:52 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.358s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:52 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Deleted volume successfully. Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created reservations ['75373120-91c8-437d-ae76-8a75874e22c3', '02fa9026-b6bc-4824-923c-719e283486d7', '3476e4df-b6ca-4dcf-a54f-80c06d692591', '65543f72-bae6-4793-bb5c-75b9c2f11aab'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:52 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-86cc5155-f9a8-425e-820a-a34694555c74 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-e6bf5a5d-8f7a-4cad-884c-06930d408a8a-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:53 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be Sep 01 02:21:53 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:53 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:53 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.info" returned: 0 in 0.349s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.info is being set with open permissions: ugo+rw Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-quobyte-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:53 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.info Sep 01 02:21:53 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[df18b708-0feb-47ff-a796-9c4bcb6a2ed1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be" returned: 0 in 0.471s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be Sep 01 02:21:53 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.339s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Deleted volume successfully. Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-158c8bc9-1693-4027-b274-24a3497be5f8 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-d9607552-0d1d-4532-92ed-9f75a5791959-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:53 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1 Sep 01 02:21:53 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.info" returned: 0 in 0.285s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.362s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.075s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de5aa990-8bbe-4d28-a640-7aedd856288c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06011d76d42749df82abbfe1a42e079a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:44Z,use_quota=True,user_id='d54ee698908248dba4a20830cfc8321b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5e170af-6582-4bff-8565-b6acca0acf6a),volume_type_id=d5e170af-6582-4bff-8565-b6acca0acf6a)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Creating volume de5aa990-8bbe-4d28-a640-7aedd856288c {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:53 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c 1073741824 Sep 01 02:21:53 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2b23cc9b-b48d-419d-bc1f-40fdc24f09e0 tempest-VolumeDependencyTests-1116740684 None] Create snapshot completed successfully Sep 01 02:21:53 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ad46f612-ff03-41fb-98bd-46e0c12506be" returned: 0 in 0.315s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-quobyte-ad46f612-ff03-41fb-98bd-46e0c12506be" released by "delete_volume" :: held 0.858s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:53 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1" returned: 0 in 0.434s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1 Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Created reservations ['9e1545da-be67-4751-827b-4e651ca44362', 'af502624-5392-4c72-84f0-cf47ad3136c5', 'f60f3805-025e-48d9-83d8-71be16ba8bdc', '0bf9d2fe-af96-4692-8eda-1604b568e2f7'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:53 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:53 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:53 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1" returned: 0 in 0.318s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1" released by "delete_volume" :: held 0.796s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created reservations ['372a3773-d4fe-45ba-9a7b-aeee561afa4e', '7710876b-7163-4cbf-881e-22d9b9c8ab0f', '36afe12b-c037-449e-8081-20f2878a84bd', 'e36c08a5-d1a5-4c4c-95cb-8d423798e692'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:54 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c 1073741824" returned: 0 in 0.622s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.379s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:54 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Deleted volume successfully. Sep 01 02:21:54 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c Sep 01 02:21:54 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-33d82af1-4bd9-45b0-866c-b6c6a1df3ed3 tempest-CreateVolumesFromImageTest-2016819546 None] Lock "cinder-ad46f612-ff03-41fb-98bd-46e0c12506be-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:54 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-f0861739-2370-49cd-aecc-205c748c9bc6-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-f0861739-2370-49cd-aecc-205c748c9bc6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-quobyte-f0861739-2370-49cd-aecc-205c748c9bc6" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-f0861739-2370-49cd-aecc-205c748c9bc6" acquired by "delete_volume" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[3942f75e-abce-4a85-be35-bcf81f2cb65c]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:54 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.379s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c" returned: 0 in 0.474s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:54 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Deleted volume successfully. Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Attempting download of 8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f ((None, [{'url': 'file:///opt/stack/data/glance/images/8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'metadata': {}}])) to volume de5aa990-8bbe-4d28-a640-7aedd856288c. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:21:54 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6 Sep 01 02:21:54 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-676c394d-20e4-4411-93da-2687272c06bf tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-b5070f0a-b5a8-49de-a8e4-ddbf42bb01d1-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[597de7cf-7661-475c-92f1-5b6068f6aa24]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_64a5sqn5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:55 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6" returned: 0 in 0.478s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:55 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_64a5sqn5 Sep 01 02:21:55 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:55 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6 Sep 01 02:21:55 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Flow 'volume_create_manager' (e9f928bf-c6fc-4944-a4f3-ff07228595a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bbf066-3656-41c8-a975-a084c83ab60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4bbf066-3656-41c8-a975-a084c83ab60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2044563443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd8c165-78d1-49d4-b251-c27ae8e8e49a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d99ab6ba271c403ea713b17a4ad74a9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:55Z,use_quota=True,user_id='191ebe85970840cabaef4f660db8c444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:55 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e76653-47c0-48f3-be82-6d3b31862d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:55 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e76653-47c0-48f3-be82-6d3b31862d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319b1543-b67c-44c4-ac79-2ade2c4ad7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319b1543-b67c-44c4-ac79-2ade2c4ad7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6cd8c165-78d1-49d4-b251-c27ae8e8e49a', 'volume_name': 'volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a', 'volume_size': 1, 'snapshot_id': '1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecffdc7e-cc91-4b82-8676-ef5280785381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecffdc7e-cc91-4b82-8676-ef5280785381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0954fa8-90a8-4f12-b70f-ea8a36686ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:55 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Volume 6cd8c165-78d1-49d4-b251-c27ae8e8e49a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a', 'volume_size': 1, 'snapshot_id': '1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d'} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_64a5sqn5" returned: 0 in 0.685s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-f0861739-2370-49cd-aecc-205c748c9bc6" returned: 0 in 0.434s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_64a5sqn5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-f0861739-2370-49cd-aecc-205c748c9bc6" released by "delete_volume" :: held 1.011s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "cinder-quobyte-1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" by "_create_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" acquired by "_create_volume_from_snapshot" :: waited 0.055s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Creating volume 6cd8c165-78d1-49d4-b251-c27ae8e8e49a from snapshot 1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d {{(pid=87389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "cinder-quobyte-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:55 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_64a5sqn5 Sep 01 02:21:55 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] snapshot: 1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d, volume: 6cd8c165-78d1-49d4-b251-c27ae8e8e49a, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6181378-4cfc-4ad3-8e58-abfbfe2b50eb]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created reservations ['abee1595-4893-4126-b1b5-d57da6ce66be', '3e502f70-2fbb-4f70-afb5-10db3dcaba5e', '1f184a7a-f634-4172-a0a6-4a24be0fce25', '670802b5-7ee0-4454-b502-f61d8e7e9ad3'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:55 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d Sep 01 02:21:55 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:55 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:55 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:55 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_64a5sqn5" returned: 1 in 0.439s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_64a5sqn5' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d279844d-cd92-4d06-b47d-b1ea3c469c91]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:56 devstack sudo[105150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD Sep 01 02:21:56 devstack sudo[105150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:56 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.302s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:56 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Deleted volume successfully. Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b37a835e-59d9-4062-8612-6d23b6652332 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-f0861739-2370-49cd-aecc-205c748c9bc6-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:56 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d" returned: 0 in 0.545s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[631c96a4-5650-4ea3-a38b-744ce2a7cc6f]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:56 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 Sep 01 02:21:56 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:56 devstack sudo[105150]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:56 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD Sep 01 02:21:56 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:56 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6" returned: 0 in 0.438s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-d9d8469d-5a75-47b8-8c2e-535f5d18271d-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-d9d8469d-5a75-47b8-8c2e-535f5d18271d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:56 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a Sep 01 02:21:56 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:56 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] 8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f was raw, converting to qcow2 {{(pid=87389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:56 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c Sep 01 02:21:56 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-quobyte-d9d8469d-5a75-47b8-8c2e-535f5d18271d" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-d9d8469d-5a75-47b8-8c2e-535f5d18271d" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cb19d3-4f54-4351-80b3-865060a61673]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:21:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:57 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d Sep 01 02:21:57 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:57 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d" returned: 0 in 0.630s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:57 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c" returned: 0 in 0.806s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:57 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f_39lr8w8xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:21:57 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:21:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:57 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d Sep 01 02:21:57 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:57 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c 1G Sep 01 02:21:57 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:58 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d9d8469d-5a75-47b8-8c2e-535f5d18271d" returned: 0 in 0.653s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-d9d8469d-5a75-47b8-8c2e-535f5d18271d" released by "delete_volume" :: held 1.388s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created reservations ['dc63e464-b4fb-4aaa-b298-7235daf6ab7c', '1de766cd-cf71-485f-b447-10991d0c8dfa', '089251b6-7350-441a-b9a1-fbb7f2e5340f', '0b143c94-27ee-4268-aabe-631d30c1a65e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:21:58 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c 1G" returned: 0 in 1.283s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Downloaded image 8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f ((None, [{'url': 'file:///opt/stack/data/glance/images/8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'metadata': {}}])) to volume de5aa990-8bbe-4d28-a640-7aedd856288c successfully. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Temporary image 8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f for user d54ee698908248dba4a20830cfc8321b is deleted. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:21:58 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Marking volume de5aa990-8bbe-4d28-a640-7aedd856288c as bootable. {{(pid=87389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:21:58 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:21:58 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:21:59 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Copying metadata from image 8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f to de5aa990-8bbe-4d28-a640-7aedd856288c. {{(pid=87389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:21:59 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Creating volume glance metadata for volume de5aa990-8bbe-4d28-a640-7aedd856288c backed by image 8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '548bad2866d6724e05646ea3056deca3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:21:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-98f39f77-b357-4121-8924-4ef66f2a4253-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:21:59 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Sep 01 02:21:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.716s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:21:59 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:21:59 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:21:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (21237d92-90f6-4b1a-93ff-1065944f273b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:21:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90edf027-986f-4e8e-afa1-c447b350c46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:21:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-98f39f77-b357-4121-8924-4ef66f2a4253-delete_volume" acquired by "delete_volume" :: waited 0.260s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:21:59 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Deleted volume successfully. Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f66b71d-362a-472e-bd98-408d3b94885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de5aa990-8bbe-4d28-a640-7aedd856288c', 'volume_size': 1, 'image_id': '8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '548bad2866d6724e05646ea3056deca3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '06011d76d42749df82abbfe1a42e079a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '25b99aeb59b278f399b7d740a9c05435c75cb008f5dcf709c7b39726f8f4583d178fcb42bfd0fde81d3f8525df3d747bcba2e9a4c84df4fef0e0d46d3517303d', 'id': '8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f', 'created_at': datetime.datetime(2026, 9, 1, 0, 21, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 21, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8ff140b3-ab2a-4bfb-8eeb-303f4c805a1f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed80b62a-43d8-45f4-b7d2-122987baab08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90edf027-986f-4e8e-afa1-c447b350c46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1427718734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9419245-efda-4ef1-b198-d652961d1429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:59Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f6ee89-45b3-4b2d-8724-37df116cc52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f6ee89-45b3-4b2d-8724-37df116cc52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f381abba-650c-4f0d-8e49-0d731ac5dec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f381abba-650c-4f0d-8e49-0d731ac5dec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9419245-efda-4ef1-b198-d652961d1429', 'volume_name': 'volume-c9419245-efda-4ef1-b198-d652961d1429', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01ec882-1389-4198-aad9-28159f3640a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01ec882-1389-4198-aad9-28159f3640a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ed945c-5451-402e-8781-f0b048770adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:00 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume c9419245-efda-4ef1-b198-d652961d1429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9419245-efda-4ef1-b198-d652961d1429', 'volume_size': 1} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:00 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Volume volume-de5aa990-8bbe-4d28-a640-7aedd856288c (de5aa990-8bbe-4d28-a640-7aedd856288c): created successfully Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed80b62a-43d8-45f4-b7d2-122987baab08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Flow 'volume_create_manager' (849e1bce-2923-4b1a-90e5-01527ab9950b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-85ff6d7b-d838-43e4-9a81-53b9cfba7f27 tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Created volume successfully. Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-quobyte-98f39f77-b357-4121-8924-4ef66f2a4253" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-587cfe7e-b6a9-438a-9565-097094248208 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-d9d8469d-5a75-47b8-8c2e-535f5d18271d-delete_volume" released by "delete_volume" :: held 3.583s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-98f39f77-b357-4121-8924-4ef66f2a4253" acquired by "delete_volume" :: waited 0.042s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[029f8d4f-6406-4b5a-a13a-2db034dd549f]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:00 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253 Sep 01 02:22:00 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Acquiring lock "cinder-de5aa990-8bbe-4d28-a640-7aedd856288c-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Lock "cinder-de5aa990-8bbe-4d28-a640-7aedd856288c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Acquiring lock "cinder-quobyte-de5aa990-8bbe-4d28-a640-7aedd856288c" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Lock "cinder-quobyte-de5aa990-8bbe-4d28-a640-7aedd856288c" acquired by "delete_volume" :: waited 0.052s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:01 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d6c461-09e3-46ad-ab74-15eeb8888c5a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:01 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253" returned: 0 in 0.857s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:01 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253 Sep 01 02:22:01 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:01 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c Sep 01 02:22:01 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:02 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-98f39f77-b357-4121-8924-4ef66f2a4253" returned: 0 in 0.677s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-98f39f77-b357-4121-8924-4ef66f2a4253" released by "delete_volume" :: held 1.630s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:02 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c" returned: 0 in 0.925s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created reservations ['12021ec0-3109-42e9-b2ed-8f37f2cc3dd2', '418d99c0-6263-4bcd-9105-e5cea036e165', 'bcffbe75-b996-4b3d-af23-38035c2d7de6', 'fc5b12f8-0fea-4fe2-bfb6-b7cf9c139a87'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:02 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c Sep 01 02:22:02 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:02 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:02 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:02 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-de5aa990-8bbe-4d28-a640-7aedd856288c" returned: 0 in 0.670s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Lock "cinder-quobyte-de5aa990-8bbe-4d28-a640-7aedd856288c" released by "delete_volume" :: held 1.673s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:02 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.452s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:02 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Deleted volume successfully. Sep 01 02:22:02 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" returned: 0 in 6.135s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:22:02 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Converted 1024.00 MB image at 166.88 MB/s Sep 01 02:22:02 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a is being set with open permissions: ugo+rw Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:02 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a Sep 01 02:22:02 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6ac5900c-adc1-4c28-a01c-f066d9adc5db tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-98f39f77-b357-4121-8924-4ef66f2a4253-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:02 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Created reservations ['c2bab43f-d5f3-4d42-84e5-8e9198060a72', 'af5ca984-cf61-4a02-bab4-9e2177fb794d', 'fbbad5bd-566e-4817-84d7-84d4e41f6aa3', 'c3ff54c8-1e39-420c-baa2-f79b5c768fa2'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:03 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:03 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-58f189d6-7f04-4f37-b3cc-9904e6ea97a5-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-58f189d6-7f04-4f37-b3cc-9904e6ea97a5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "cinder-quobyte-58f189d6-7f04-4f37-b3cc-9904e6ea97a5" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:03 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" returned: 0 in 0.292s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-58f189d6-7f04-4f37-b3cc-9904e6ea97a5" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" released by "_copy_volume_from_snapshot" :: held 7.549s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[418bd80b-cc1e-4e59-88e2-3306e1cb56a5]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" released by "_create_volume_from_snapshot" :: held 7.677s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.734s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.094s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1427718734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9419245-efda-4ef1-b198-d652961d1429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:21:59Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Creating volume c9419245-efda-4ef1-b198-d652961d1429 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:03 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:03 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 1073741824 Sep 01 02:22:03 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0954fa8-90a8-4f12-b70f-ea8a36686ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a', 'volume_size': 1, 'snapshot_id': '1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:03 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5 Sep 01 02:22:03 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1dc7585-9f8b-4e88-8365-16c43b8b78c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:03 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.382s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:03 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Volume volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a (6cd8c165-78d1-49d4-b251-c27ae8e8e49a): created successfully Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1dc7585-9f8b-4e88-8365-16c43b8b78c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Flow 'volume_create_manager' (e9f928bf-c6fc-4944-a4f3-ff07228595a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:03 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Deleted volume successfully. Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d43d18f6-09a6-43dd-a596-bf73d89f61dd tempest-VolumeAndVolumeTypeFromImageTest-726944777 None] Lock "cinder-de5aa990-8bbe-4d28-a640-7aedd856288c-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:03 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-08ff9842-bdbd-4de7-9caf-9f66c97bfe8a tempest-VolumeDependencyTests-1116740684 None] Created volume successfully. Sep 01 02:22:03 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5" returned: 0 in 0.544s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:03 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5 Sep 01 02:22:03 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:03 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 1073741824" returned: 0 in 0.672s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:04 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-58f189d6-7f04-4f37-b3cc-9904e6ea97a5" returned: 0 in 0.286s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:04 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 Sep 01 02:22:04 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-quobyte-58f189d6-7f04-4f37-b3cc-9904e6ea97a5" released by "delete_volume" :: held 0.881s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Created reservations ['e2bfda69-b36c-4703-abbd-ac6a8b866fbb', '65db6d8a-029a-4611-af58-ee4a41320bd9', 'cfb29561-75e5-44cb-b4e5-9191caf99831', 'a85ef0f7-759e-4a2a-aec2-09381ad5377d'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "cinder-1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:04 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:04 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "cinder-quobyte-8bbbe888-88ac-488b-bc54-52b59ddf00b6" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-8bbbe888-88ac-488b-bc54-52b59ddf00b6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "cinder-quobyte-1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Deleting offline snapshot 1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d of volume 8bbbe888-88ac-488b-bc54-52b59ddf00b6 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] snapshot_file for this snap is: volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:04 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429" returned: 0 in 0.413s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba91555e-f47b-4f43-a9f1-bc0e2889cc70]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6ed945c-5451-402e-8781-f0b048770adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9419245-efda-4ef1-b198-d652961d1429', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4d7868-a626-4b6d-b1b7-97fadb4bd8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:04 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume volume-c9419245-efda-4ef1-b198-d652961d1429 (c9419245-efda-4ef1-b198-d652961d1429): created successfully Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e4d7868-a626-4b6d-b1b7-97fadb4bd8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (21237d92-90f6-4b1a-93ff-1065944f273b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:04 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7d29cf85-67bb-45a3-990c-f58089a2025e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created volume successfully. Sep 01 02:22:04 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d Sep 01 02:22:04 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:04 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.369s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:04 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Deleted volume successfully. Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ebe0a0b2-64ca-4e17-bec3-f041597b05e7 tempest-CreateVolumesFromSourceVolumeTest-639395760 None] Lock "cinder-58f189d6-7f04-4f37-b3cc-9904e6ea97a5-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:04 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d" returned: 0 in 0.491s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:05 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f126516d-12bf-4bdd-bc6e-400f45f600a1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Creating offline snapshot 6a6eb3b4-7180-42d6-b2a1-fa33db70f946 of volume c9419245-efda-4ef1-b198-d652961d1429 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:05 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1449082-1acb-4960-a108-4b879a20e6fb]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:05 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 Sep 01 02:22:05 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:05 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 Sep 01 02:22:05 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:05 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429" returned: 0 in 0.520s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:05 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 1G Sep 01 02:22:05 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:05 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6" returned: 0 in 0.699s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:05 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d Sep 01 02:22:05 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:06 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 1G" returned: 0 in 0.540s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9419245-efda-4ef1-b198-d652961d1429 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:06 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d" returned: 0 in 0.464s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:06 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9419245-efda-4ef1-b198-d652961d1429 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 Sep 01 02:22:06 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:06 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d Sep 01 02:22:06 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:06 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6.1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d" returned: 0 in 0.335s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d" released by "_delete_snapshot" :: held 2.147s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-8bbbe888-88ac-488b-bc54-52b59ddf00b6" released by "delete_snapshot" :: held 2.184s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:06 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9419245-efda-4ef1-b198-d652961d1429 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946" returned: 0 in 0.449s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:06 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 is being set with open permissions: ugo+rw Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:06 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 Sep 01 02:22:06 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Created reservations ['fffbc124-eb19-4b1d-80c7-6ce783d5a767', '3df93f2f-c2f1-4139-86cd-3894670daca7', '8329c686-a507-490d-98c2-8e98f968131d', '35f1b96b-cf56-4edc-ba30-1c2cda5716ed'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:06 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Delete snapshot completed successfully. Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-32b7be90-2707-4385-acca-5e389727a105 tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-1c6e77d7-f793-4e9b-bcb1-5cd318d4cc1d-delete_snapshot" released by "delete_snapshot" :: held 2.426s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:06 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946" returned: 0 in 0.317s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:06 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.info Sep 01 02:22:06 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:07 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.info" returned: 0 in 0.329s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:07 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.info is being set with open permissions: ugo+rw Sep 01 02:22:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:07 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.info Sep 01 02:22:07 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:07 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:07 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "cinder-8bbbe888-88ac-488b-bc54-52b59ddf00b6-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.info" returned: 0 in 0.336s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.611s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:07 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-8bbbe888-88ac-488b-bc54-52b59ddf00b6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:07 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5c7643ae-2519-40ee-9f51-4447293be032 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Create snapshot completed successfully Sep 01 02:22:07 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "cinder-quobyte-8bbbe888-88ac-488b-bc54-52b59ddf00b6" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:07 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-8bbbe888-88ac-488b-bc54-52b59ddf00b6" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:07 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad741e87-a279-464e-adfd-fd0ae61f74a5]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:07 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 Sep 01 02:22:07 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:08 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6" returned: 0 in 0.490s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:08 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6 Sep 01 02:22:08 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:08 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8bbbe888-88ac-488b-bc54-52b59ddf00b6" returned: 0 in 0.414s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-8bbbe888-88ac-488b-bc54-52b59ddf00b6" released by "delete_volume" :: held 0.999s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:08 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (7cd360bc-b3fc-4ec9-a718-f1e2b5347581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e59792b-dae7-4570-9cc8-b4140bba91e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:08 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e59792b-dae7-4570-9cc8-b4140bba91e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1685363430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bb0d40-95ef-4e06-8289-f71a997316dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:09Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a05ae8-ecde-4321-8295-8fb8d8d0c3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06a05ae8-ecde-4321-8295-8fb8d8d0c3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64a9482-cd16-4a27-9651-324aff1e1305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a64a9482-cd16-4a27-9651-324aff1e1305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84bb0d40-95ef-4e06-8289-f71a997316dd', 'volume_name': 'volume-84bb0d40-95ef-4e06-8289-f71a997316dd', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2eb8fd-a58f-4054-868a-017dfa3931d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc2eb8fd-a58f-4054-868a-017dfa3931d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dbadd17-d54c-44d9-8362-d65ef40d675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:09 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume 84bb0d40-95ef-4e06-8289-f71a997316dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84bb0d40-95ef-4e06-8289-f71a997316dd', 'volume_size': 1} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1685363430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84bb0d40-95ef-4e06-8289-f71a997316dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:09Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Creating volume 84bb0d40-95ef-4e06-8289-f71a997316dd {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:09 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Created reservations ['99664507-94d6-4246-a2ce-8b03e9b5495b', '39a44e77-5eee-40df-ae53-2366dce2d054', '468e7f7b-4bfb-4585-8035-8196d4e9e1a1', '28cc3f4f-ff3d-4a3a-8260-efce2f03a354'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:09 devstack sudo[105310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd 1073741824 Sep 01 02:22:09 devstack sudo[105310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:09 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:09 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (df0db75c-0b92-4244-b536-027d83caa8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444f5604-ae0d-425f-ab27-8198b2dafc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444f5604-ae0d-425f-ab27-8198b2dafc8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2118778423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e07bd5-50d3-4e87-88b4-a40e42abd9b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:09Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:09 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b477c11a-53a8-45ef-bfbf-0e9b972ec84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b477c11a-53a8-45ef-bfbf-0e9b972ec84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592d93b7-de54-4e9b-a967-0a577daf0019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592d93b7-de54-4e9b-a967-0a577daf0019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00e07bd5-50d3-4e87-88b4-a40e42abd9b5', 'volume_name': 'volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a77f800-5acc-4c78-ae0b-83e320414314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a77f800-5acc-4c78-ae0b-83e320414314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c690948-7a95-498d-bac3-a14dd3ed4cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:09 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume 00e07bd5-50d3-4e87-88b4-a40e42abd9b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5', 'volume_size': 1} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.531s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:09 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Deleted volume successfully. Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8b449be0-d878-4371-a60b-97ba71abdb4d tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-8bbbe888-88ac-488b-bc54-52b59ddf00b6-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:09 devstack sudo[105310]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd 1073741824" returned: 0 in 0.806s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:09 devstack sudo[105319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd Sep 01 02:22:09 devstack sudo[105319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "cinder-6cd8c165-78d1-49d4-b251-c27ae8e8e49a-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-6cd8c165-78d1-49d4-b251-c27ae8e8e49a-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "cinder-quobyte-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" acquired by "delete_volume" :: waited 0.039s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2361ed16-b987-45c8-ae92-857131924775]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:10 devstack sudo[105319]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd" returned: 0 in 0.409s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.615s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2118778423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00e07bd5-50d3-4e87-88b4-a40e42abd9b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:09Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Creating volume 00e07bd5-50d3-4e87-88b4-a40e42abd9b5 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:10 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dbadd17-d54c-44d9-8362-d65ef40d675b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84bb0d40-95ef-4e06-8289-f71a997316dd', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:10 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5 1073741824 Sep 01 02:22:10 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162df00f-b107-44cd-bc13-00c5689fe8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:10 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume volume-84bb0d40-95ef-4e06-8289-f71a997316dd (84bb0d40-95ef-4e06-8289-f71a997316dd): created successfully Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (162df00f-b107-44cd-bc13-00c5689fe8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (7cd360bc-b3fc-4ec9-a718-f1e2b5347581) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:10 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a Sep 01 02:22:10 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:10 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1c650946-d17d-42e0-a327-201793c69db8 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created volume successfully. Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (6cd6b6eb-e514-4b7e-80f4-0e1a70ada15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8196ee-384d-4566-8121-ba28b51a44a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d8196ee-384d-4566-8121-ba28b51a44a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1871934597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d379961-3ba4-4bd8-b231-88c02122cbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:10Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac94510-f799-4eda-ba22-8f4f58a4cee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac94510-f799-4eda-ba22-8f4f58a4cee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220c6bd7-3d34-422d-b2e0-a8e636840b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (220c6bd7-3d34-422d-b2e0-a8e636840b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d379961-3ba4-4bd8-b231-88c02122cbf3', 'volume_name': 'volume-0d379961-3ba4-4bd8-b231-88c02122cbf3', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d2903e-3ed0-4b05-a209-ed1ce5dc7cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d2903e-3ed0-4b05-a209-ed1ce5dc7cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad374461-8a1e-4238-84a8-6be55bdcded2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:10 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume 0d379961-3ba4-4bd8-b231-88c02122cbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d379961-3ba4-4bd8-b231-88c02122cbf3', 'volume_size': 1} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:10 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" returned: 0 in 0.593s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:10 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a Sep 01 02:22:10 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (3e7b1c74-3ff1-46de-b9dc-ad48b7a1f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c188c31-b39b-4237-bbb9-0698e0628445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c188c31-b39b-4237-bbb9-0698e0628445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1286125996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0880a3ff-b8dc-4dd1-82b5-5c21600aef69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:11Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409e8872-7809-4304-82e8-034de3ca3626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409e8872-7809-4304-82e8-034de3ca3626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a187477-ce2c-483a-ab79-feaedc6fd8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a187477-ce2c-483a-ab79-feaedc6fd8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0880a3ff-b8dc-4dd1-82b5-5c21600aef69', 'volume_name': 'volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a670b2-0b34-48d5-9cc0-b9229698de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a670b2-0b34-48d5-9cc0-b9229698de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:11 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8d4d2f-e824-40bd-ae44-9204d6657ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:11 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume 0880a3ff-b8dc-4dd1-82b5-5c21600aef69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69', 'volume_size': 1} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5 1073741824" returned: 0 in 0.819s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:11 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5 Sep 01 02:22:11 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:11 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" returned: 0 in 0.387s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-quobyte-6cd8c165-78d1-49d4-b251-c27ae8e8e49a" released by "delete_volume" :: held 1.073s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Created reservations ['fbcb1311-534f-4b26-8f68-fc6e02a2b586', '2e2809e1-cdd1-41b0-a9ce-e592c629cb3b', '1160dd4a-f9df-436b-a5c6-766175e881e1', '5323e150-d4c9-4c42-b492-76f932bab20c'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:11 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:11 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:11 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5" returned: 0 in 0.479s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1871934597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d379961-3ba4-4bd8-b231-88c02122cbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:10Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Creating volume 0d379961-3ba4-4bd8-b231-88c02122cbf3 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:11 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c690948-7a95-498d-bac3-a14dd3ed4cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:11 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3 1073741824 Sep 01 02:22:11 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff30892e-f68a-4ed9-945b-32da3badf972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:11 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5 (00e07bd5-50d3-4e87-88b4-a40e42abd9b5): created successfully Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff30892e-f68a-4ed9-945b-32da3badf972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (df0db75c-0b92-4244-b536-027d83caa8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:11 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-63f8e47a-3089-465c-bc58-825276021530 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created volume successfully. Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (2ddbd7f2-1ce1-43ea-8195-8a1b013b1fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:11 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b02897-b537-4c90-bc8c-4e662b26fe11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:12 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b02897-b537-4c90-bc8c-4e662b26fe11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1488812065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b3b34b-e303-407d-ae78-62a547d191f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:12Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eae704c-91a5-4ea0-98bb-56304806fe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eae704c-91a5-4ea0-98bb-56304806fe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6176e787-4941-42e0-aad0-11b0991391d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6176e787-4941-42e0-aad0-11b0991391d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b3b34b-e303-407d-ae78-62a547d191f4', 'volume_name': 'volume-b6b3b34b-e303-407d-ae78-62a547d191f4', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690978df-dc62-47ba-be83-ba25c49a55bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690978df-dc62-47ba-be83-ba25c49a55bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40eb7f03-378e-4233-bd5e-ec2d75d6e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:12 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume b6b3b34b-e303-407d-ae78-62a547d191f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b3b34b-e303-407d-ae78-62a547d191f4', 'volume_size': 1} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.394s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:12 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Deleted volume successfully. Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-0018bf67-52fc-422e-a33d-7302e959f05f tempest-VolumeDependencyTests-1116740684 None] Lock "cinder-6cd8c165-78d1-49d4-b251-c27ae8e8e49a-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:12 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3 1073741824" returned: 0 in 0.614s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:12 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3 Sep 01 02:22:12 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:12 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3" returned: 0 in 0.378s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1286125996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0880a3ff-b8dc-4dd1-82b5-5c21600aef69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:11Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Creating volume 0880a3ff-b8dc-4dd1-82b5-5c21600aef69 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:12 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad374461-8a1e-4238-84a8-6be55bdcded2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d379961-3ba4-4bd8-b231-88c02122cbf3', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:12 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69 1073741824 Sep 01 02:22:12 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ba114e-ae4d-49d6-952a-c75fce9357a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:12 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume volume-0d379961-3ba4-4bd8-b231-88c02122cbf3 (0d379961-3ba4-4bd8-b231-88c02122cbf3): created successfully Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ba114e-ae4d-49d6-952a-c75fce9357a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (6cd6b6eb-e514-4b7e-80f4-0e1a70ada15a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:12 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e57059a9-2076-4c89-9aff-f9339e397a74 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created volume successfully. Sep 01 02:22:13 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69 1073741824" returned: 0 in 0.663s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:13 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69 Sep 01 02:22:13 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:13 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69" returned: 0 in 0.348s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.806s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1488812065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b3b34b-e303-407d-ae78-62a547d191f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6553383c361b41098fe7edeb63111eaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:12Z,use_quota=True,user_id='32d46686189741729aa63c4cd1e28206',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Creating volume b6b3b34b-e303-407d-ae78-62a547d191f4 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:13 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc8d4d2f-e824-40bd-ae44-9204d6657ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5d4363-0f90-4a55-aa5e-8e2b7d7c4c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:13 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4 1073741824 Sep 01 02:22:13 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:14 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69 (0880a3ff-b8dc-4dd1-82b5-5c21600aef69): created successfully Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5d4363-0f90-4a55-aa5e-8e2b7d7c4c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (3e7b1c74-3ff1-46de-b9dc-ad48b7a1f95c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Flow 'volume_create_manager' (90098f7e-29ad-480b-ba9e-267a31c591c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7291c9-2f19-4225-bf1a-46b6228aafae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c45e4667-f944-48e1-9a2d-94e95fe2b522 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created volume successfully. Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7291c9-2f19-4225-bf1a-46b6228aafae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c78b0dc-67ec-46f9-b69a-237b05cf9e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41568ad2e4fd43d69b549b79c63e29fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:14Z,use_quota=True,user_id='9282d84de21f449a8eded0423f0c93ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c4e0d0-64e2-4f82-90a0-4fd0cc2f6353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86c4e0d0-64e2-4f82-90a0-4fd0cc2f6353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5497bf-91d1-4caf-b1ff-f457a286987e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.image.glance [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Creating Keystone auth plugin from conf {{(pid=87389) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5497bf-91d1-4caf-b1ff-f457a286987e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c78b0dc-67ec-46f9-b69a-237b05cf9e65', 'volume_name': 'volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65', 'volume_size': 1, 'image_id': '5db783b8-9d2c-40c7-be88-160b16b6b850', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5db783b8-9d2c-40c7-be88-160b16b6b850', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6934664bf2e343997ecd53789404a71', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41568ad2e4fd43d69b549b79c63e29fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd3ba681a00df0ed3cde54d4c1d0eeaf38cc5c0579a9ee57b770c22018c35fc4e7d7f877e5b1352639917a2e50595fd0edf25c763aaa9db796435e9b5a2b072c', 'id': '5db783b8-9d2c-40c7-be88-160b16b6b850', 'created_at': datetime.datetime(2026, 9, 1, 0, 22, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 22, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5db783b8-9d2c-40c7-be88-160b16b6b850/file', 'properties': {}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffc52ad-7162-4dae-850b-0be8dd7fb542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffc52ad-7162-4dae-850b-0be8dd7fb542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b82a143-c14c-4a0b-bc2f-6079210c407c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:14 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Volume 1c78b0dc-67ec-46f9-b69a-237b05cf9e65: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65', 'volume_size': 1, 'image_id': '5db783b8-9d2c-40c7-be88-160b16b6b850', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5db783b8-9d2c-40c7-be88-160b16b6b850', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6934664bf2e343997ecd53789404a71', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41568ad2e4fd43d69b549b79c63e29fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd3ba681a00df0ed3cde54d4c1d0eeaf38cc5c0579a9ee57b770c22018c35fc4e7d7f877e5b1352639917a2e50595fd0edf25c763aaa9db796435e9b5a2b072c', 'id': '5db783b8-9d2c-40c7-be88-160b16b6b850', 'created_at': datetime.datetime(2026, 9, 1, 0, 22, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 22, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5db783b8-9d2c-40c7-be88-160b16b6b850/file', 'properties': {}}, 'image_service': } Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Trying to clone 1c78b0dc-67ec-46f9-b69a-237b05cf9e65 from image 5db783b8-9d2c-40c7-be88-160b16b6b850 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5db783b8-9d2c-40c7-be88-160b16b6b850', 'metadata': {}}]). {{(pid=87389) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 01 02:22:14 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4 1073741824" returned: 0 in 0.774s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 01 02:22:14 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Image download 0.00 MB at 0.00 MB/s Sep 01 02:22:14 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4 Sep 01 02:22:14 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[004d07d7-6cdf-4eb7-9905-727af1f1d2cd]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:14 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD Sep 01 02:22:14 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:15 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4" returned: 0 in 0.396s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40eb7f03-378e-4233-bd5e-ec2d75d6e807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b3b34b-e303-407d-ae78-62a547d191f4', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e135760d-70f1-4ac7-9d31-5c9b40e7d79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:15 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Volume volume-b6b3b34b-e303-407d-ae78-62a547d191f4 (b6b3b34b-e303-407d-ae78-62a547d191f4): created successfully Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e135760d-70f1-4ac7-9d31-5c9b40e7d79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Flow 'volume_create_manager' (2ddbd7f2-1ce1-43ea-8195-8a1b013b1fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:15 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b2f4d256-ed50-435c-9d0f-2dec7069e5d3 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created volume successfully. Sep 01 02:22:15 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-b6b3b34b-e303-407d-ae78-62a547d191f4-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-b6b3b34b-e303-407d-ae78-62a547d191f4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-quobyte-b6b3b34b-e303-407d-ae78-62a547d191f4" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:15 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD Sep 01 02:22:15 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-b6b3b34b-e303-407d-ae78-62a547d191f4" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03d8096-10c2-4156-ade6-2f447b909cc0]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:15 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4 Sep 01 02:22:15 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:15 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD" returned: 1 in 0.434s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Temporary image 5db783b8-9d2c-40c7-be88-160b16b6b850 is fetched for user 9282d84de21f449a8eded0423f0c93ec. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1851ee6-f40c-4bdf-b886-6c12f2f06a3c]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:15 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:15 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD Sep 01 02:22:15 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4" returned: 0 in 0.451s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:15 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4 Sep 01 02:22:15 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:16 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:16 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-b6b3b34b-e303-407d-ae78-62a547d191f4" returned: 0 in 0.323s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-b6b3b34b-e303-407d-ae78-62a547d191f4" released by "delete_volume" :: held 0.844s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:16 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD Sep 01 02:22:16 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created reservations ['cc045f7f-a987-4059-a481-2e3cb8d5bbf1', 'c13fbde3-31bf-4194-9eaa-c8aa996979c1', 'e7efc6e3-2666-411d-9b18-6b9e51641d30', 'd4fbd729-e602-478d-9d83-0447c5a7cee7'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:16 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:16 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:16 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD" returned: 1 in 0.452s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c78b0dc-67ec-46f9-b69a-237b05cf9e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41568ad2e4fd43d69b549b79c63e29fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:14Z,use_quota=True,user_id='9282d84de21f449a8eded0423f0c93ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Creating volume 1c78b0dc-67ec-46f9-b69a-237b05cf9e65 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:16 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-0880a3ff-b8dc-4dd1-82b5-5c21600aef69-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:16 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 1073741824 Sep 01 02:22:16 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-0880a3ff-b8dc-4dd1-82b5-5c21600aef69-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-quobyte-0880a3ff-b8dc-4dd1-82b5-5c21600aef69" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-0880a3ff-b8dc-4dd1-82b5-5c21600aef69" acquired by "delete_volume" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:16 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.388s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:16 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Deleted volume successfully. Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac80e48-a7da-4983-b146-2277dc0df97a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c503357c-eda8-4bd0-aba3-2f1596e9814b tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-b6b3b34b-e303-407d-ae78-62a547d191f4-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:16 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69 Sep 01 02:22:16 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:17 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 1073741824" returned: 0 in 0.603s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:17 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 Sep 01 02:22:17 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:17 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69" returned: 0 in 0.547s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:17 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69 Sep 01 02:22:17 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Flow 'volume_create_manager' (5be28cd5-09eb-40ad-93b8-9e6ee9b3372b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b74afc-5654-428f-9307-7b01ff1bf6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66b74afc-5654-428f-9307-7b01ff1bf6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cac4f8-8d72-4afd-95d0-f3ce374cbfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629808380f4f45be832f75869ad1eefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:17Z,use_quota=True,user_id='28dda9d80bfd439bac4ffd20bed99edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8800b226-d1c2-4113-9cf9-a79173393ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8800b226-d1c2-4113-9cf9-a79173393ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ce7141-5d62-4eed-b064-7fdadac30328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39ce7141-5d62-4eed-b064-7fdadac30328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13cac4f8-8d72-4afd-95d0-f3ce374cbfa9', 'volume_name': 'volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b3320b-caff-4b09-8ed9-de3daf0a2285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b3320b-caff-4b09-8ed9-de3daf0a2285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a01d807-9174-45f3-a5ae-9e127085c4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:17 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Volume 13cac4f8-8d72-4afd-95d0-f3ce374cbfa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9', 'volume_size': 1} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:17 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65" returned: 0 in 0.305s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.045s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cac4f8-8d72-4afd-95d0-f3ce374cbfa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629808380f4f45be832f75869ad1eefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:17Z,use_quota=True,user_id='28dda9d80bfd439bac4ffd20bed99edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Creating volume 13cac4f8-8d72-4afd-95d0-f3ce374cbfa9 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:17 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Attempting download of 5db783b8-9d2c-40c7-be88-160b16b6b850 ((None, [{'url': 'file:///opt/stack/data/glance/images/5db783b8-9d2c-40c7-be88-160b16b6b850', 'metadata': {}}])) to volume 1c78b0dc-67ec-46f9-b69a-237b05cf9e65. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 01 02:22:17 devstack sudo[105423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9 1073741824 Sep 01 02:22:17 devstack sudo[105423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:17 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0880a3ff-b8dc-4dd1-82b5-5c21600aef69" returned: 0 in 0.320s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-0880a3ff-b8dc-4dd1-82b5-5c21600aef69" released by "delete_volume" :: held 0.945s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e4884b-e511-47f2-9128-87bf66686ef4]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5db783b8-9d2c-40c7-be88-160b16b6b850_z6hnpx32 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created reservations ['b0f71fa9-0aab-4f02-bada-a7f97f45cdfd', 'a8526c1f-8325-467d-9528-ee45b9349b7d', '3d73b48e-d2e8-4c05-8461-4f8b371126d1', '79e9e6c4-3215-4383-832f-2ee7b2b32718'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:17 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5db783b8-9d2c-40c7-be88-160b16b6b850_z6hnpx32 Sep 01 02:22:17 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:17 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:17 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:17 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-0d379961-3ba4-4bd8-b231-88c02122cbf3-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-0d379961-3ba4-4bd8-b231-88c02122cbf3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:18 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5db783b8-9d2c-40c7-be88-160b16b6b850_z6hnpx32" returned: 0 in 0.373s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5db783b8-9d2c-40c7-be88-160b16b6b850_z6hnpx32 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-quobyte-0d379961-3ba4-4bd8-b231-88c02122cbf3" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-0d379961-3ba4-4bd8-b231-88c02122cbf3" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:18 devstack sudo[105423]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:18 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9 1073741824" returned: 0 in 0.546s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.304s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[811cd989-c66c-46b2-aa14-92b5bb495931]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:18 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Deleted volume successfully. Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-1922d5c5-1c47-4d71-9db7-a1884b9c9d4d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-0880a3ff-b8dc-4dd1-82b5-5c21600aef69-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:18 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5db783b8-9d2c-40c7-be88-160b16b6b850_z6hnpx32 Sep 01 02:22:18 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:18 devstack sudo[105439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9 Sep 01 02:22:18 devstack sudo[105439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:18 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3 Sep 01 02:22:18 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:18 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5db783b8-9d2c-40c7-be88-160b16b6b850_z6hnpx32" returned: 1 in 0.443s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5db783b8-9d2c-40c7-be88-160b16b6b850_z6hnpx32' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e0fbff-ee5f-4b3f-8218-1e441a94fc0f]: (4, 'raw') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:18 devstack sudo[105439]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9" returned: 0 in 0.333s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a01d807-9174-45f3-a5ae-9e127085c4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba2dd08-f434-4045-a1f5-526b88bed85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:18 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Volume volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9 (13cac4f8-8d72-4afd-95d0-f3ce374cbfa9): created successfully Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fba2dd08-f434-4045-a1f5-526b88bed85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Flow 'volume_create_manager' (5be28cd5-09eb-40ad-93b8-9e6ee9b3372b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:18 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-54dd8d4b-cfe3-4ab7-869e-6bbbb2ed5665 tempest-CinderUnicodeTest-1399558969 None] Created volume successfully. Sep 01 02:22:18 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3" returned: 0 in 0.507s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:18 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD Sep 01 02:22:18 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:18 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3 Sep 01 02:22:18 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:18 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:18 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0d379961-3ba4-4bd8-b231-88c02122cbf3" returned: 0 in 0.267s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-0d379961-3ba4-4bd8-b231-88c02122cbf3" released by "delete_volume" :: held 0.822s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created reservations ['70550de3-23c9-402d-95f4-7cc0270d38f0', 'cfeb251e-20b2-42b5-9b38-0ce181caa3c7', '9cc6cfde-6f40-404e-a6ec-682ba39b6e7a', 'b287030b-ccab-4714-bf49-6301a7ba461a'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:19 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD Sep 01 02:22:19 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:19 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:19 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-00e07bd5-50d3-4e87-88b4-a40e42abd9b5-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-00e07bd5-50d3-4e87-88b4-a40e42abd9b5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-quobyte-00e07bd5-50d3-4e87-88b4-a40e42abd9b5" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:19 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD" returned: 1 in 0.395s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] 5db783b8-9d2c-40c7-be88-160b16b6b850 was raw, converting to qcow2 {{(pid=87389) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-00e07bd5-50d3-4e87-88b4-a40e42abd9b5" acquired by "delete_volume" :: waited 0.065s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:19 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 Sep 01 02:22:19 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cba49df-e74b-4d89-9d04-3f4f7773727c]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:19 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.410s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Deleted volume successfully. Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f1650e22-4752-43ff-9431-917b2dad6166 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-0d379961-3ba4-4bd8-b231-88c02122cbf3-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:19 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5 Sep 01 02:22:19 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:19 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5" returned: 0 in 0.463s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:19 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5 Sep 01 02:22:19 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:20 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65" returned: 0 in 0.661s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5db783b8-9d2c-40c7-be88-160b16b6b850_o73k20_7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:22:20 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Converted 0.00 MB image at 0.00 MB/s Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:20 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 1G Sep 01 02:22:20 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Flow 'volume_create_manager' (bc81d38c-e091-4dc1-821c-74f0c74a20c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338af177-ccf9-458b-82b1-ec619832badb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338af177-ccf9-458b-82b1-ec619832badb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-300177664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9895ab81-1786-4e11-be5d-25053c83b121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629808380f4f45be832f75869ad1eefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:20Z,use_quota=True,user_id='28dda9d80bfd439bac4ffd20bed99edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:20 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e9beb4-f35f-4022-890c-410e1e637ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e9beb4-f35f-4022-890c-410e1e637ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03facbba-4029-44c5-b0eb-23280401a5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03facbba-4029-44c5-b0eb-23280401a5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9895ab81-1786-4e11-be5d-25053c83b121', 'volume_name': 'volume-9895ab81-1786-4e11-be5d-25053c83b121', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9238c14-6e6a-4d30-9c59-957316a8bdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9238c14-6e6a-4d30-9c59-957316a8bdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622a8a80-9a2e-4442-92bc-d60728b6a147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:20 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Volume 9895ab81-1786-4e11-be5d-25053c83b121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9895ab81-1786-4e11-be5d-25053c83b121', 'volume_size': 1} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-300177664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9895ab81-1786-4e11-be5d-25053c83b121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='629808380f4f45be832f75869ad1eefd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:20Z,use_quota=True,user_id='28dda9d80bfd439bac4ffd20bed99edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Creating volume 9895ab81-1786-4e11-be5d-25053c83b121 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:20 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-00e07bd5-50d3-4e87-88b4-a40e42abd9b5" returned: 0 in 0.344s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:20 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 1073741824 Sep 01 02:22:20 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-00e07bd5-50d3-4e87-88b4-a40e42abd9b5" released by "delete_volume" :: held 0.887s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created reservations ['1d95da7c-c480-4ae3-96d1-cec0e850c144', '08e632fb-c09e-45bf-bca2-3d9e6b630931', 'f1070589-5bf7-4371-9978-a0fce3fda2aa', 'fc576963-8972-43d4-9d71-96849128e294'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:20 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 1G" returned: 0 in 0.338s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Downloaded image 5db783b8-9d2c-40c7-be88-160b16b6b850 ((None, [{'url': 'file:///opt/stack/data/glance/images/5db783b8-9d2c-40c7-be88-160b16b6b850', 'metadata': {}}])) to volume 1c78b0dc-67ec-46f9-b69a-237b05cf9e65 successfully. {{(pid=87389) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Temporary image 5db783b8-9d2c-40c7-be88-160b16b6b850 for user 9282d84de21f449a8eded0423f0c93ec is deleted. {{(pid=87389) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.volume_utils [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Marking volume 1c78b0dc-67ec-46f9-b69a-237b05cf9e65 as bootable. {{(pid=87389) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Copying metadata from image 5db783b8-9d2c-40c7-be88-160b16b6b850 to 1c78b0dc-67ec-46f9-b69a-237b05cf9e65. {{(pid=87389) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Creating volume glance metadata for volume 1c78b0dc-67ec-46f9-b69a-237b05cf9e65 backed by image 5db783b8-9d2c-40c7-be88-160b16b6b850 with: {'image_id': '5db783b8-9d2c-40c7-be88-160b16b6b850', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b6934664bf2e343997ecd53789404a71', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87389) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:20 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:20 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-84bb0d40-95ef-4e06-8289-f71a997316dd-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-84bb0d40-95ef-4e06-8289-f71a997316dd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b82a143-c14c-4a0b-bc2f-6079210c407c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65', 'volume_size': 1, 'image_id': '5db783b8-9d2c-40c7-be88-160b16b6b850', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5db783b8-9d2c-40c7-be88-160b16b6b850', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6934664bf2e343997ecd53789404a71', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '41568ad2e4fd43d69b549b79c63e29fb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dd3ba681a00df0ed3cde54d4c1d0eeaf38cc5c0579a9ee57b770c22018c35fc4e7d7f877e5b1352639917a2e50595fd0edf25c763aaa9db796435e9b5a2b072c', 'id': '5db783b8-9d2c-40c7-be88-160b16b6b850', 'created_at': datetime.datetime(2026, 9, 1, 0, 22, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 1, 0, 22, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5db783b8-9d2c-40c7-be88-160b16b6b850/file', 'properties': {}}, 'image_service': }' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d7f24c-1edb-402b-b055-343cc74ce50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-quobyte-84bb0d40-95ef-4e06-8289-f71a997316dd" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:20 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Volume volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 (1c78b0dc-67ec-46f9-b69a-237b05cf9e65): created successfully Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7d7f24c-1edb-402b-b055-343cc74ce50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Flow 'volume_create_manager' (90098f7e-29ad-480b-ba9e-267a31c591c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-469d7da1-a930-4b73-b9f1-728415b9475e tempest-VolumeImageDependencyTests-757026430 None] Created volume successfully. Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-84bb0d40-95ef-4e06-8289-f71a997316dd" acquired by "delete_volume" :: waited 0.051s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37a7d85-52e1-4e80-82d5-0960723275fc]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:20 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.322s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:20 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Deleted volume successfully. Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a86d2516-96c7-4115-8ded-8042a335467d tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-00e07bd5-50d3-4e87-88b4-a40e42abd9b5-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:20 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd Sep 01 02:22:20 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:20 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 1073741824" returned: 0 in 0.634s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:20 devstack sudo[105496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 Sep 01 02:22:20 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:21 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd" returned: 0 in 0.450s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:21 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd Sep 01 02:22:21 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:21 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622a8a80-9a2e-4442-92bc-d60728b6a147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9895ab81-1786-4e11-be5d-25053c83b121', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba9f5e7-fd97-485f-b992-935fe5bf949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:21 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Volume volume-9895ab81-1786-4e11-be5d-25053c83b121 (9895ab81-1786-4e11-be5d-25053c83b121): created successfully Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bba9f5e7-fd97-485f-b992-935fe5bf949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Flow 'volume_create_manager' (bc81d38c-e091-4dc1-821c-74f0c74a20c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-14e84af5-24ba-457a-863a-3a8dd6b45cc1 tempest-CinderUnicodeTest-1399558969 None] Created volume successfully. Sep 01 02:22:21 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-84bb0d40-95ef-4e06-8289-f71a997316dd" returned: 0 in 0.289s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-84bb0d40-95ef-4e06-8289-f71a997316dd" released by "delete_volume" :: held 0.791s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created reservations ['e18e2bd1-9b47-41c8-927c-5b6c1b3bfdba', '0e94b0b7-0842-427b-bf15-5c7a5bdf9a85', 'bc775f86-ccde-4f90-bb55-0aa900569b35', '35bc0d1d-0ace-436f-8cd8-87615b524865'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:21 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:21 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Acquiring lock "cinder-1c78b0dc-67ec-46f9-b69a-237b05cf9e65-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-6a6eb3b4-7180-42d6-b2a1-fa33db70f946-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Lock "cinder-1c78b0dc-67ec-46f9-b69a-237b05cf9e65-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-6a6eb3b4-7180-42d6-b2a1-fa33db70f946-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-quobyte-c9419245-efda-4ef1-b198-d652961d1429" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-c9419245-efda-4ef1-b198-d652961d1429" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-quobyte-6a6eb3b4-7180-42d6-b2a1-fa33db70f946" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Acquiring lock "cinder-quobyte-1c78b0dc-67ec-46f9-b69a-237b05cf9e65" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-6a6eb3b4-7180-42d6-b2a1-fa33db70f946" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Deleting offline snapshot 6a6eb3b4-7180-42d6-b2a1-fa33db70f946 of volume c9419245-efda-4ef1-b198-d652961d1429 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] snapshot_file for this snap is: volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Lock "cinder-quobyte-1c78b0dc-67ec-46f9-b69a-237b05cf9e65" acquired by "delete_volume" :: waited 0.043s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fb32b6-f37a-4cc8-8cb3-f115fe4c0c04]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:21 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91a1734-c9ab-464d-af18-55c94fed1096]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Deleted volume successfully. Sep 01 02:22:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a322391e-43d7-4a8d-bf49-4c3a177ac55e tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-84bb0d40-95ef-4e06-8289-f71a997316dd-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:21 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 Sep 01 02:22:21 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:21 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 Sep 01 02:22:21 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:22 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946" returned: 0 in 0.383s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9419245-efda-4ef1-b198-d652961d1429(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:22 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65" returned: 0 in 0.386s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16b3661-9339-4bee-b468-5e0d13aeb898]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:22 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65 Sep 01 02:22:22 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:22 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 Sep 01 02:22:22 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:22 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c78b0dc-67ec-46f9-b69a-237b05cf9e65" returned: 0 in 0.295s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Lock "cinder-quobyte-1c78b0dc-67ec-46f9-b69a-237b05cf9e65" released by "delete_volume" :: held 0.732s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] Creating offline snapshot 75f1c250-a14b-465d-8e02-894e8e41a275 of volume 9895ab81-1786-4e11-be5d-25053c83b121 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c82af8b-96d6-4112-8093-e815d21fd848]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Created reservations ['f7418079-d5cd-480f-91cf-43647c9b0218', 'f842573a-38bd-419e-9938-c5aa1db32131', '7f4b8b19-6c6a-40cd-9d20-0c5540d7a1e9', '8880dc77-8990-4b6d-bb4e-9e92cd385bec'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:22 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:22 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:22 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429" returned: 0 in 0.609s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:22 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:22 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:22 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 Sep 01 02:22:22 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:23 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.367s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:23 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Deleted volume successfully. Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-5568e337-8499-4e11-abd1-d7fd743c4fb4 tempest-VolumeImageDependencyTests-757026430 None] Lock "cinder-1c78b0dc-67ec-46f9-b69a-237b05cf9e65-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:23 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121" returned: 0 in 0.710s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:23 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 1G Sep 01 02:22:23 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:23 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946" returned: 0 in 0.537s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:23 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946 Sep 01 02:22:23 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:23 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429.6a6eb3b4-7180-42d6-b2a1-fa33db70f946" returned: 0 in 0.318s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-6a6eb3b4-7180-42d6-b2a1-fa33db70f946" released by "_delete_snapshot" :: held 1.997s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-c9419245-efda-4ef1-b198-d652961d1429" released by "delete_snapshot" :: held 2.023s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created reservations ['fa79410f-b6af-42a2-9b3a-d3b46a7451e8', '71c0eb9e-2247-471f-802f-fbde677be369', 'f4ccaea4-cbda-4e18-b092-5113739f54e4', '670de042-8e93-43aa-b524-a2bbb8fe64c3'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:23 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 1G" returned: 0 in 0.545s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9895ab81-1786-4e11-be5d-25053c83b121 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:23 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9895ab81-1786-4e11-be5d-25053c83b121 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 Sep 01 02:22:23 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:23 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Delete snapshot completed successfully. Sep 01 02:22:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-51b266f9-2fc9-4e82-a59e-c698c824e328 tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-6a6eb3b4-7180-42d6-b2a1-fa33db70f946-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:24 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9895ab81-1786-4e11-be5d-25053c83b121 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275" returned: 0 in 0.403s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:24 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 is being set with open permissions: ugo+rw Sep 01 02:22:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:24 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 Sep 01 02:22:24 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:24 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275" returned: 0 in 0.311s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:24 devstack sudo[105557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.info Sep 01 02:22:24 devstack sudo[105557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:24 devstack sudo[105557]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.info" returned: 0 in 0.320s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:24 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.info is being set with open permissions: ugo+rw Sep 01 02:22:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:25 devstack sudo[105560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.info Sep 01 02:22:25 devstack sudo[105560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-c9419245-efda-4ef1-b198-d652961d1429-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-c9419245-efda-4ef1-b198-d652961d1429-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "cinder-quobyte-c9419245-efda-4ef1-b198-d652961d1429" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-c9419245-efda-4ef1-b198-d652961d1429" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f92d215-46d3-4c08-8727-7de721860834]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:25 devstack sudo[105560]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.info" returned: 0 in 0.390s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.819s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:25 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 Sep 01 02:22:25 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-db7436c7-42d8-45b1-9666-cfbf3654cd93 tempest-CinderUnicodeTest-1399558969 None] Create snapshot completed successfully Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "cinder-75f1c250-a14b-465d-8e02-894e8e41a275-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-75f1c250-a14b-465d-8e02-894e8e41a275-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "cinder-quobyte-9895ab81-1786-4e11-be5d-25053c83b121" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:25 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429" returned: 0 in 0.521s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-quobyte-9895ab81-1786-4e11-be5d-25053c83b121" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "cinder-quobyte-75f1c250-a14b-465d-8e02-894e8e41a275" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:25 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429 Sep 01 02:22:25 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-quobyte-75f1c250-a14b-465d-8e02-894e8e41a275" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Deleting offline snapshot 75f1c250-a14b-465d-8e02-894e8e41a275 of volume 9895ab81-1786-4e11-be5d-25053c83b121 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] snapshot_file for this snap is: volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ba4626-a954-47a9-a3b8-8e9a75e04f98]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:26 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 Sep 01 02:22:26 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:26 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c9419245-efda-4ef1-b198-d652961d1429" returned: 0 in 0.322s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-quobyte-c9419245-efda-4ef1-b198-d652961d1429" released by "delete_volume" :: held 0.937s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Created reservations ['0168adae-fd13-45e4-84de-d3a24fa9dc19', '9de910e1-618f-46f5-bbdb-63d5ef42620b', '817ebd7d-70e9-4a40-abc8-dafa132374bf', 'c1dd59de-e51e-4ce1-8c87-8ea03b0d4ac9'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:26 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275" returned: 0 in 0.509s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9895ab81-1786-4e11-be5d-25053c83b121(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:26 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:26 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eaed76a-5ea7-42b3-b630-9310cef2fcb1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:26 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 Sep 01 02:22:26 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:26 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.337s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:26 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Deleted volume successfully. Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6365fa4c-eadc-41a4-9ed3-8df406a43afd tempest-CreateVolumesFromSnapshotTest-2145565317 None] Lock "cinder-c9419245-efda-4ef1-b198-d652961d1429-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:26 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121" returned: 0 in 0.445s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:26 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 Sep 01 02:22:26 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:27 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275" returned: 0 in 0.394s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:27 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275 Sep 01 02:22:27 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:27 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121.75f1c250-a14b-465d-8e02-894e8e41a275" returned: 0 in 0.330s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-quobyte-75f1c250-a14b-465d-8e02-894e8e41a275" released by "_delete_snapshot" :: held 1.817s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-quobyte-9895ab81-1786-4e11-be5d-25053c83b121" released by "delete_snapshot" :: held 1.855s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:27 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Created reservations ['f3b1b980-75c2-46da-a3b1-5354a428ca10', 'eab618f4-a3ab-4a53-8903-4cd496279a79', 'b2e26434-311d-4388-9dff-8efcd0785311', 'f8a035ff-7fb1-4f69-aeb5-9be9cccde5d0'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:27 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Delete snapshot completed successfully. Sep 01 02:22:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f7a6659-2bfc-4b1d-9745-bc3bb48c0370 tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-75f1c250-a14b-465d-8e02-894e8e41a275-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:27 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "cinder-9895ab81-1786-4e11-be5d-25053c83b121-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-9895ab81-1786-4e11-be5d-25053c83b121-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "cinder-quobyte-9895ab81-1786-4e11-be5d-25053c83b121" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:28 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-quobyte-9895ab81-1786-4e11-be5d-25053c83b121" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:28 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[b616ba8f-00f5-4472-9125-b6dad77948c6]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:28 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 Sep 01 02:22:28 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121" returned: 0 in 0.602s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:28 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:28 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121 Sep 01 02:22:28 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:29 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9895ab81-1786-4e11-be5d-25053c83b121" returned: 0 in 0.460s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-quobyte-9895ab81-1786-4e11-be5d-25053c83b121" released by "delete_volume" :: held 1.169s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Created reservations ['1c68cf11-973e-44c8-9cbc-fbb17626a8bc', '31c82d89-3b59-42e5-b095-6142c2c76d23', 'bea869cc-6957-48d9-99b2-c398af202f89', 'ded5ac2d-d416-4116-8de2-bf747a13ea24'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:29 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:29 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:29 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.302s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:29 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Deleted volume successfully. Sep 01 02:22:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-adf21762-2802-4224-89d4-a5eb75081b45 tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-9895ab81-1786-4e11-be5d-25053c83b121-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "cinder-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "cinder-quobyte-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:30 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-quobyte-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9" acquired by "delete_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:30 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[636be37b-5bb0-405b-9732-9f1954606b69]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:30 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9 Sep 01 02:22:30 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:30 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9" returned: 0 in 0.446s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:30 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9 Sep 01 02:22:30 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:31 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9" returned: 0 in 0.361s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-quobyte-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9" released by "delete_volume" :: held 0.877s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Created reservations ['541e0de3-1395-432c-9802-5a9622f7ba16', 'b95b2865-046c-4b95-bc57-f8ee143619cc', '9b5e34df-ca2e-4891-8668-6eac4cc4ec33', '1b072208-58c1-49bb-8af0-72fd0d53f80c'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:31 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:31 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:31 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.357s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:31 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Deleted volume successfully. Sep 01 02:22:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e331af47-b786-4422-bb4d-408ed54d50ec tempest-CinderUnicodeTest-1399558969 None] Lock "cinder-13cac4f8-8d72-4afd-95d0-f3ce374cbfa9-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-23c83d94-de8a-4ea0-8898-9e315b377647 tempest-ProjectAdminTests-1936568724 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.0478439331055, 'free_capacity_gb': 1774.0478439331055, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87389) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:UPDATE=272,cinder:SELECT=203,cinder:INSERT=76,cinder:DELETE=26 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=200,cinder:UPDATE=283,cinder:INSERT=73,cinder:DELETE=23 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (b28fb613-2eb2-455c-8715-34e5666c4e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c128f38-1e0a-4a93-8a64-2ff68bf30016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c128f38-1e0a-4a93-8a64-2ff68bf30016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1443297732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c9b5b1-e1d7-4072-b852-f15efd5be99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:37Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e93e43-9f08-4ca6-a156-372f3f3f5aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50e93e43-9f08-4ca6-a156-372f3f3f5aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07889159-44cb-48e7-bcd4-682b98f5f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07889159-44cb-48e7-bcd4-682b98f5f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03c9b5b1-e1d7-4072-b852-f15efd5be99a', 'volume_name': 'volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36eee039-ba62-48fb-941c-e607b10a5666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36eee039-ba62-48fb-941c-e607b10a5666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffd4ee8-9389-4379-87b4-5a47115dcc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:37 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Volume 03c9b5b1-e1d7-4072-b852-f15efd5be99a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a', 'volume_size': 1} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1443297732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03c9b5b1-e1d7-4072-b852-f15efd5be99a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:37Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Creating volume 03c9b5b1-e1d7-4072-b852-f15efd5be99a {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:37 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:37 devstack sudo[105655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a 1073741824 Sep 01 02:22:37 devstack sudo[105655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:38 devstack sudo[105655]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a 1073741824" returned: 0 in 0.600s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:38 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a Sep 01 02:22:38 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:38 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a" returned: 0 in 0.464s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.139s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffd4ee8-9389-4379-87b4-5a47115dcc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1022cb-ce01-45fa-99e9-3f6188817333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:38 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Volume volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a (03c9b5b1-e1d7-4072-b852-f15efd5be99a): created successfully Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1022cb-ce01-45fa-99e9-3f6188817333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (b28fb613-2eb2-455c-8715-34e5666c4e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:38 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-cc7dc2b3-e9e3-43bd-9a8b-f69ea6918a8b tempest-ProjectMemberTests-485697174 None] Created volume successfully. Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Flow 'volume_create_manager' (4f8ac6a1-3107-40d1-9caa-4500ef14ac7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec2dda8-563d-4b30-b0df-c58e8af2a03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec2dda8-563d-4b30-b0df-c58e8af2a03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278246098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886d0400-3751-4355-934d-9f69d0c5f6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e486782d804c769cc5ae2a9179bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:39Z,use_quota=True,user_id='fa45bd91be0f465ea7656f6d2565f570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2851f6-736f-4575-b9aa-4b926ba9d512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2851f6-736f-4575-b9aa-4b926ba9d512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fc30ba-3854-4f3b-a4b0-2c59c98b0eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52fc30ba-3854-4f3b-a4b0-2c59c98b0eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '886d0400-3751-4355-934d-9f69d0c5f6f7', 'volume_name': 'volume-886d0400-3751-4355-934d-9f69d0c5f6f7', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeab79a6-6457-42b8-b90f-cfe84b9e3037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeab79a6-6457-42b8-b90f-cfe84b9e3037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b796b6e1-3d91-43a2-97da-33e2801c756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:38 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Volume 886d0400-3751-4355-934d-9f69d0c5f6f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-886d0400-3751-4355-934d-9f69d0c5f6f7', 'volume_size': 1} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278246098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=886d0400-3751-4355-934d-9f69d0c5f6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e486782d804c769cc5ae2a9179bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:39Z,use_quota=True,user_id='fa45bd91be0f465ea7656f6d2565f570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Creating volume 886d0400-3751-4355-934d-9f69d0c5f6f7 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:38 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:38 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 1073741824 Sep 01 02:22:38 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:39 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 1073741824" returned: 0 in 0.487s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:39 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 Sep 01 02:22:39 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:39 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7" returned: 0 in 0.349s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:39 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b796b6e1-3d91-43a2-97da-33e2801c756a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-886d0400-3751-4355-934d-9f69d0c5f6f7', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3befae-b01b-4c49-a292-b4a87c4a2fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:39 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Volume volume-886d0400-3751-4355-934d-9f69d0c5f6f7 (886d0400-3751-4355-934d-9f69d0c5f6f7): created successfully Sep 01 02:22:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3befae-b01b-4c49-a292-b4a87c4a2fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:39 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Flow 'volume_create_manager' (4f8ac6a1-3107-40d1-9caa-4500ef14ac7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:39 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3fb755ae-55a8-44f0-ad25-04eb61686fbc tempest-ProjectReaderTests-1417274899 None] Created volume successfully. Sep 01 02:22:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] Creating offline snapshot 290c7f58-7def-41df-a5bd-1c54db2c874b of volume 03c9b5b1-e1d7-4072-b852-f15efd5be99a {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:40 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baff835-e58e-44e8-859e-98f0a93acf0e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:40 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a Sep 01 02:22:40 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:40 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a" returned: 0 in 0.450s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:40 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b 1G Sep 01 02:22:40 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:41 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b 1G" returned: 0 in 0.478s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:41 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b Sep 01 02:22:41 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:41 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b" returned: 0 in 0.380s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:41 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b is being set with open permissions: ugo+rw Sep 01 02:22:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:41 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b Sep 01 02:22:41 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:41 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b" returned: 0 in 0.260s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:41 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.info Sep 01 02:22:41 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:42 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.info" returned: 0 in 0.270s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:42 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.info is being set with open permissions: ugo+rw Sep 01 02:22:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:42 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.info Sep 01 02:22:42 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:42 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.info" returned: 0 in 0.263s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.901s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] Creating offline snapshot 468b3794-9c8e-404b-8f64-e9338caf485a of volume 886d0400-3751-4355-934d-9f69d0c5f6f7 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:42 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9a7c9ac6-4a75-4230-9d38-34a500f42d8a tempest-ProjectMemberTests-485697174 None] Create snapshot completed successfully Sep 01 02:22:42 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e430e8c-19cf-4aca-bbf2-57b8f39b8809]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:42 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 Sep 01 02:22:42 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:42 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7" returned: 0 in 0.486s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:42 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a 1G Sep 01 02:22:42 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-290c7f58-7def-41df-a5bd-1c54db2c874b-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Lock "cinder-290c7f58-7def-41df-a5bd-1c54db2c874b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-03c9b5b1-e1d7-4072-b852-f15efd5be99a" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-03c9b5b1-e1d7-4072-b852-f15efd5be99a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-290c7f58-7def-41df-a5bd-1c54db2c874b" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-290c7f58-7def-41df-a5bd-1c54db2c874b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Deleting offline snapshot 290c7f58-7def-41df-a5bd-1c54db2c874b of volume 03c9b5b1-e1d7-4072-b852-f15efd5be99a {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] snapshot_file for this snap is: volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f8229f-55bc-4667-b3df-39c64f5c277a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:43 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a 1G" returned: 0 in 0.539s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886d0400-3751-4355-934d-9f69d0c5f6f7 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:43 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886d0400-3751-4355-934d-9f69d0c5f6f7 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a Sep 01 02:22:43 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:43 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b Sep 01 02:22:43 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:43 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-886d0400-3751-4355-934d-9f69d0c5f6f7 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a" returned: 0 in 0.464s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:43 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a is being set with open permissions: ugo+rw Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:43 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a Sep 01 02:22:43 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:43 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b" returned: 0 in 0.562s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:43 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c52d85-11c1-439d-8fad-b59a814d3a76]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:44 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a Sep 01 02:22:44 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:44 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a" returned: 0 in 0.350s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:44 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.info Sep 01 02:22:44 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:44 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a" returned: 0 in 0.514s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:44 devstack sudo[105732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b Sep 01 02:22:44 devstack sudo[105732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:44 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.info" returned: 0 in 0.369s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:44 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.info is being set with open permissions: ugo+rw Sep 01 02:22:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:44 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.info Sep 01 02:22:44 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:45 devstack sudo[105732]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:45 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b" returned: 0 in 0.465s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.info" returned: 0 in 0.343s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:45 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b Sep 01 02:22:45 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.708s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:45 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-10a1430c-bc7f-4924-bbd9-4d3dd0b8f17d tempest-ProjectReaderTests-1417274899 None] Create snapshot completed successfully Sep 01 02:22:45 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a.290c7f58-7def-41df-a5bd-1c54db2c874b" returned: 0 in 0.284s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-290c7f58-7def-41df-a5bd-1c54db2c874b" released by "_delete_snapshot" :: held 1.996s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-03c9b5b1-e1d7-4072-b852-f15efd5be99a" released by "delete_snapshot" :: held 2.040s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:45 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Created reservations ['363187b6-a502-4b72-a122-2a9b221c915c', 'cbff8bc3-efd2-47a2-951f-c72876dfe4b4', 'b6aa0f3e-3cb6-4f04-ad8a-e69ec03e830f', 'c995947f-6718-404d-b6e3-6c93e4b717ce'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:45 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Delete snapshot completed successfully. Sep 01 02:22:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b252bdbd-1e46-4b9e-bbff-0bb1731291c6 tempest-ProjectMemberTests-485697174 None] Lock "cinder-290c7f58-7def-41df-a5bd-1c54db2c874b-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-468b3794-9c8e-404b-8f64-e9338caf485a-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-468b3794-9c8e-404b-8f64-e9338caf485a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-886d0400-3751-4355-934d-9f69d0c5f6f7" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-886d0400-3751-4355-934d-9f69d0c5f6f7" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-468b3794-9c8e-404b-8f64-e9338caf485a" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-468b3794-9c8e-404b-8f64-e9338caf485a" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Deleting offline snapshot 468b3794-9c8e-404b-8f64-e9338caf485a of volume 886d0400-3751-4355-934d-9f69d0c5f6f7 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] snapshot_file for this snap is: volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[700629e4-8dc1-474b-8ec3-fa14bc77fda9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:46 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a Sep 01 02:22:46 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-03c9b5b1-e1d7-4072-b852-f15efd5be99a-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Lock "cinder-03c9b5b1-e1d7-4072-b852-f15efd5be99a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-03c9b5b1-e1d7-4072-b852-f15efd5be99a" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-03c9b5b1-e1d7-4072-b852-f15efd5be99a" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc800266-3cbe-47af-8763-223bc22a015a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:46 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a Sep 01 02:22:46 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:47 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a" returned: 0 in 0.781s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-886d0400-3751-4355-934d-9f69d0c5f6f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbdb853-8914-4af4-9ffa-30b7ef5131c1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:47 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 Sep 01 02:22:47 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:47 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a" returned: 0 in 0.499s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:47 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a Sep 01 02:22:47 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:47 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:47 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:47 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-03c9b5b1-e1d7-4072-b852-f15efd5be99a" returned: 0 in 0.325s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-03c9b5b1-e1d7-4072-b852-f15efd5be99a" released by "delete_volume" :: held 0.915s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:47 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.358s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:22:47 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7" returned: 0 in 0.607s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:47 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a Sep 01 02:22:47 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Created reservations ['a2e1bfb8-f358-4ba2-a61d-b4427ccfaf77', 'af6b7841-d6a4-44f6-8e54-63dbb4a6824f', '2e8b86be-e877-42cf-943d-e99fa3f9b574', '20dbb1bd-1d62-4f8e-b9d6-ebd705dabd70'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:47 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:47 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:48 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a" returned: 0 in 0.437s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:48 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a Sep 01 02:22:48 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:48 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.346s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:48 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Deleted volume successfully. Sep 01 02:22:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9fd1747d-a974-4728-9ca4-05861183916f tempest-ProjectMemberTests-485697174 None] Lock "cinder-03c9b5b1-e1d7-4072-b852-f15efd5be99a-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:48 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7.468b3794-9c8e-404b-8f64-e9338caf485a" returned: 0 in 0.327s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-468b3794-9c8e-404b-8f64-e9338caf485a" released by "_delete_snapshot" :: held 2.309s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-886d0400-3751-4355-934d-9f69d0c5f6f7" released by "delete_snapshot" :: held 2.357s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:48 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Created reservations ['2bef6482-9ed6-4f63-ade7-80f7ecee7ad0', '2d5d4fd1-f478-4857-b15b-6471f983ed01', '6eabc7c7-1f59-45ad-acb0-74987d141f4f', '49d3c8fd-b699-4a8f-8792-a945fc008146'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Delete snapshot completed successfully. Sep 01 02:22:48 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2f4657d1-50a8-4b08-91d2-66b51f566e83 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-468b3794-9c8e-404b-8f64-e9338caf485a-delete_snapshot" released by "delete_snapshot" :: held 2.551s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-886d0400-3751-4355-934d-9f69d0c5f6f7-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Lock "cinder-886d0400-3751-4355-934d-9f69d0c5f6f7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-886d0400-3751-4355-934d-9f69d0c5f6f7" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-886d0400-3751-4355-934d-9f69d0c5f6f7" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be12e88-e752-47a8-88e9-3035ae5c3a08]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (c8a5cc64-62e0-4a7c-9e72-da5ecb446ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c22776b-df7a-4f23-800a-413e756233cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c22776b-df7a-4f23-800a-413e756233cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046468287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ec0cac-3adc-4a3c-9d41-baaae96c59af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:49Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf85acd5-7351-40c9-a71d-0f8bcde8809a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf85acd5-7351-40c9-a71d-0f8bcde8809a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bc60a3-42fb-41f1-b98f-3e6a3389761a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71bc60a3-42fb-41f1-b98f-3e6a3389761a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6ec0cac-3adc-4a3c-9d41-baaae96c59af', 'volume_name': 'volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:49 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9174d706-88e0-41e4-95ce-1f8bd6f271ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:49 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9174d706-88e0-41e4-95ce-1f8bd6f271ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4fbad7-8b6f-4267-a7d9-b3d38bd95076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:49 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Volume c6ec0cac-3adc-4a3c-9d41-baaae96c59af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af', 'volume_size': 1} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1046468287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6ec0cac-3adc-4a3c-9d41-baaae96c59af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:49Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Creating volume c6ec0cac-3adc-4a3c-9d41-baaae96c59af {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:49 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:49 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af 1073741824 Sep 01 02:22:49 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:49 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7" returned: 0 in 0.458s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:50 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7 Sep 01 02:22:50 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:50 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af 1073741824" returned: 0 in 0.585s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:50 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-886d0400-3751-4355-934d-9f69d0c5f6f7" returned: 0 in 0.311s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-886d0400-3751-4355-934d-9f69d0c5f6f7" released by "delete_volume" :: held 0.893s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:50 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af Sep 01 02:22:50 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Created reservations ['c3c3866a-6e3f-4e75-ab92-79e7a6c088ce', '4eeaee62-233e-4545-8708-2007c85f1017', '1240650c-51cf-41f1-8d20-1def71788a17', '208680ea-715a-4b71-a76e-e8a1eeba88fe'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:50 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:22:50 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:50 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af" returned: 0 in 0.409s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4fbad7-8b6f-4267-a7d9-b3d38bd95076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d397215-d693-4361-87b8-a289de9788d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:50 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Volume volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af (c6ec0cac-3adc-4a3c-9d41-baaae96c59af): created successfully Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d397215-d693-4361-87b8-a289de9788d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (c8a5cc64-62e0-4a7c-9e72-da5ecb446ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:50 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a59c1239-f75f-47df-818b-50b176bffdc6 tempest-ProjectMemberTests-485697174 None] Created volume successfully. Sep 01 02:22:50 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.347s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:22:50 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Deleted volume successfully. Sep 01 02:22:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-fff38aa7-abdb-4c39-9322-c6e246cf76da tempest-ProjectReaderTests-1417274899 None] Lock "cinder-886d0400-3751-4355-934d-9f69d0c5f6f7-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Flow 'volume_create_manager' (0400967a-745d-4f9f-87cd-45fa9bff6a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2284cc14-cdfd-4397-9fa0-a7428ff6e5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2284cc14-cdfd-4397-9fa0-a7428ff6e5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1004588238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d87a28-d32f-478c-baa0-a126e7a3a94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e486782d804c769cc5ae2a9179bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:51Z,use_quota=True,user_id='fa45bd91be0f465ea7656f6d2565f570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1542b7e0-ad2d-4c5f-8bab-50904348b43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1542b7e0-ad2d-4c5f-8bab-50904348b43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea3c5bb-45b1-4e56-b203-7db927624ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea3c5bb-45b1-4e56-b203-7db927624ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7d87a28-d32f-478c-baa0-a126e7a3a94b', 'volume_name': 'volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67c41e7-ef7b-44f2-a5ef-b9696f5d485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67c41e7-ef7b-44f2-a5ef-b9696f5d485e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc8a59f-3f5c-47a5-a117-c1317605cfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:51 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Volume d7d87a28-d32f-478c-baa0-a126e7a3a94b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b', 'volume_size': 1} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1004588238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d87a28-d32f-478c-baa0-a126e7a3a94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e486782d804c769cc5ae2a9179bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:22:51Z,use_quota=True,user_id='fa45bd91be0f465ea7656f6d2565f570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Creating volume d7d87a28-d32f-478c-baa0-a126e7a3a94b {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:51 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:51 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b 1073741824 Sep 01 02:22:51 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:51 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b 1073741824" returned: 0 in 0.590s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:52 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b Sep 01 02:22:52 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:52 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b" returned: 0 in 0.294s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.547s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc8a59f-3f5c-47a5-a117-c1317605cfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7955ab6c-b40b-4fc6-a2c1-27b5ae6b46ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] Creating offline snapshot e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 of volume c6ec0cac-3adc-4a3c-9d41-baaae96c59af {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:52 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Volume volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b (d7d87a28-d32f-478c-baa0-a126e7a3a94b): created successfully Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7955ab6c-b40b-4fc6-a2c1-27b5ae6b46ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Flow 'volume_create_manager' (0400967a-745d-4f9f-87cd-45fa9bff6a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2ea939-3f06-4053-87ce-a743bdaf39e1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:52 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3da90945-7a94-4148-a8fb-b28d274b63bc tempest-ProjectReaderTests-1417274899 None] Created volume successfully. Sep 01 02:22:52 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af Sep 01 02:22:52 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:52 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af" returned: 0 in 0.470s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:52 devstack sudo[105812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 1G Sep 01 02:22:52 devstack sudo[105812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:53 devstack sudo[105812]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 1G" returned: 0 in 0.451s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:53 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 Sep 01 02:22:53 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:53 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2" returned: 0 in 0.560s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:53 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 is being set with open permissions: ugo+rw Sep 01 02:22:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:53 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 Sep 01 02:22:53 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:54 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2" returned: 0 in 0.312s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:54 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.info Sep 01 02:22:54 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:54 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.info" returned: 0 in 0.318s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:54 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.info is being set with open permissions: ugo+rw Sep 01 02:22:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:54 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.info Sep 01 02:22:54 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:54 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.info" returned: 0 in 0.350s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.620s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.943s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] Creating offline snapshot a20cb255-89e9-4a5b-9e3c-230c895d7d4d of volume d7d87a28-d32f-478c-baa0-a126e7a3a94b {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:22:55 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7b387ad7-60c0-4fb6-8668-8efd303ddb99 tempest-ProjectMemberTests-485697174 None] Create snapshot completed successfully Sep 01 02:22:55 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c520398-6eef-401a-bd29-791963918578]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:55 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b Sep 01 02:22:55 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:55 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b" returned: 0 in 0.485s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:55 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d 1G Sep 01 02:22:55 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-e327792f-b8a6-4cb0-bd99-cc24ea9e30c2-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Lock "cinder-e327792f-b8a6-4cb0-bd99-cc24ea9e30c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-c6ec0cac-3adc-4a3c-9d41-baaae96c59af" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-c6ec0cac-3adc-4a3c-9d41-baaae96c59af" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-e327792f-b8a6-4cb0-bd99-cc24ea9e30c2" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-e327792f-b8a6-4cb0-bd99-cc24ea9e30c2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Deleting offline snapshot e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 of volume c6ec0cac-3adc-4a3c-9d41-baaae96c59af {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] snapshot_file for this snap is: volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:56 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d 1G" returned: 0 in 0.679s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b419a44-788f-464b-8495-7a5103e79fd7]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:56 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d Sep 01 02:22:56 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:56 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 Sep 01 02:22:56 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:56 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d" returned: 0 in 0.353s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:56 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d is being set with open permissions: ugo+rw Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:56 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d Sep 01 02:22:56 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:56 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2" returned: 0 in 0.609s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d069a1-02a1-485a-8cd4-b2b6c52350f0]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:56 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d" returned: 0 in 0.339s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:56 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.info Sep 01 02:22:56 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:57 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af Sep 01 02:22:57 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:57 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.info" returned: 0 in 0.376s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:57 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.info is being set with open permissions: ugo+rw Sep 01 02:22:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:57 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af" returned: 0 in 0.475s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:57 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.info Sep 01 02:22:57 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:57 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 Sep 01 02:22:57 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:57 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.info" returned: 0 in 0.402s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.791s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:57 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6f3c1265-0994-4207-9009-0c1eb4ba28bc tempest-ProjectReaderTests-1417274899 None] Create snapshot completed successfully Sep 01 02:22:57 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2" returned: 0 in 0.489s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:57 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2 Sep 01 02:22:57 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:58 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af.e327792f-b8a6-4cb0-bd99-cc24ea9e30c2" returned: 0 in 0.311s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-e327792f-b8a6-4cb0-bd99-cc24ea9e30c2" released by "_delete_snapshot" :: held 2.074s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-c6ec0cac-3adc-4a3c-9d41-baaae96c59af" released by "delete_snapshot" :: held 2.122s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-a20cb255-89e9-4a5b-9e3c-230c895d7d4d-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Lock "cinder-a20cb255-89e9-4a5b-9e3c-230c895d7d4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-d7d87a28-d32f-478c-baa0-a126e7a3a94b" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Created reservations ['c20fa6a2-178b-4076-8ba2-88690599ef86', '782c8517-3e07-4446-a16d-b29f49326c5c', '435e1121-2d4b-4817-bc76-f195c7f1439e', '558da646-e9bf-4edb-a06f-03567b3f33c1'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-d7d87a28-d32f-478c-baa0-a126e7a3a94b" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-a20cb255-89e9-4a5b-9e3c-230c895d7d4d" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-a20cb255-89e9-4a5b-9e3c-230c895d7d4d" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Deleting offline snapshot a20cb255-89e9-4a5b-9e3c-230c895d7d4d of volume d7d87a28-d32f-478c-baa0-a126e7a3a94b {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] snapshot_file for this snap is: volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae6417b-0b36-4cb5-b441-3f86e6a6f844]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:58 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Delete snapshot completed successfully. Sep 01 02:22:58 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a0d7932a-1690-4f43-a57b-ceb4da52f249 tempest-ProjectMemberTests-485697174 None] Lock "cinder-e327792f-b8a6-4cb0-bd99-cc24ea9e30c2-delete_snapshot" released by "delete_snapshot" :: held 2.558s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:22:58 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d Sep 01 02:22:58 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:59 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d" returned: 0 in 0.496s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc92a40-7af5-4a5d-8e5e-5a82a391ffdf]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:59 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b Sep 01 02:22:59 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-c6ec0cac-3adc-4a3c-9d41-baaae96c59af-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Lock "cinder-c6ec0cac-3adc-4a3c-9d41-baaae96c59af-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-c6ec0cac-3adc-4a3c-9d41-baaae96c59af" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-c6ec0cac-3adc-4a3c-9d41-baaae96c59af" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:22:59 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b" returned: 0 in 0.576s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf67e15e-ec3c-4f4f-83e9-cb0f084c0f14]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:22:59 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d Sep 01 02:22:59 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Flow 'volume_create_manager' (598d2e28-a464-4705-87d8-9ab56fa81412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a769d8-7333-4175-add9-31f12540a7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:59 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af Sep 01 02:22:59 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a769d8-7333-4175-add9-31f12540a7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1524917531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c171d88-807f-4c61-8ea7-9783aac566ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c2c662493746d0848e3cee858b48d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:00Z,use_quota=True,user_id='df8f2a7392bb4781874addb5e1d949f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35f1a7f-842a-4440-828e-4967f5cdf2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35f1a7f-842a-4440-828e-4967f5cdf2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05a7177-d756-4f35-bff9-84659156e6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e05a7177-d756-4f35-bff9-84659156e6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c171d88-807f-4c61-8ea7-9783aac566ef', 'volume_name': 'volume-1c171d88-807f-4c61-8ea7-9783aac566ef', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed18e8df-4a84-40a5-98a9-85554af33d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed18e8df-4a84-40a5-98a9-85554af33d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56648244-d977-4b56-bf49-49b20c70a74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:22:59 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Volume 1c171d88-807f-4c61-8ea7-9783aac566ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c171d88-807f-4c61-8ea7-9783aac566ef', 'volume_size': 1} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1524917531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c171d88-807f-4c61-8ea7-9783aac566ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c2c662493746d0848e3cee858b48d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:00Z,use_quota=True,user_id='df8f2a7392bb4781874addb5e1d949f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Creating volume 1c171d88-807f-4c61-8ea7-9783aac566ef {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:22:59 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:22:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef 1073741824 Sep 01 02:23:00 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d" returned: 0 in 0.388s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d Sep 01 02:23:00 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af" returned: 0 in 0.461s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af Sep 01 02:23:00 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b.a20cb255-89e9-4a5b-9e3c-230c895d7d4d" returned: 0 in 0.275s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-a20cb255-89e9-4a5b-9e3c-230c895d7d4d" released by "_delete_snapshot" :: held 1.899s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-d7d87a28-d32f-478c-baa0-a126e7a3a94b" released by "delete_snapshot" :: held 1.947s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:00 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef 1073741824" returned: 0 in 0.485s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-c6ec0cac-3adc-4a3c-9d41-baaae96c59af" returned: 0 in 0.295s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-c6ec0cac-3adc-4a3c-9d41-baaae96c59af" released by "delete_volume" :: held 0.856s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Created reservations ['41138c37-59fb-43ad-a7fe-241007fa68b7', '2928fb38-d4b5-4681-acff-6a3e5a4ef888', '82f47b42-88e0-49ef-a2d5-27cdb5d8df62', 'b7e3c172-aa6e-45e9-b923-687f4010c745'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:00 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef Sep 01 02:23:00 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Created reservations ['8f0b12c9-fc3d-4d07-a210-db09545d1464', '29243f2e-7faa-4ee6-8c7a-3887395c09f6', 'd69f905c-ffb6-4d50-be81-ef141f69cc90', '40588491-ca4d-44c2-99fa-cb4b1498a35f'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Delete snapshot completed successfully. Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-15c0a9d3-25fc-478c-a143-e4eafbf25abe tempest-ProjectReaderTests-1417274899 None] Lock "cinder-a20cb255-89e9-4a5b-9e3c-230c895d7d4d-delete_snapshot" released by "delete_snapshot" :: held 2.218s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-d7d87a28-d32f-478c-baa0-a126e7a3a94b-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:00 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:00 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-d7d87a28-d32f-478c-baa0-a126e7a3a94b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-d7d87a28-d32f-478c-baa0-a126e7a3a94b" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-d7d87a28-d32f-478c-baa0-a126e7a3a94b" acquired by "delete_volume" :: waited 0.035s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:00 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef" returned: 0 in 0.359s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56648244-d977-4b56-bf49-49b20c70a74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c171d88-807f-4c61-8ea7-9783aac566ef', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237e97d2-97b3-4757-a5af-0c6177b9677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7186f870-9a9a-4eeb-ac38-3c4aabcb0b1d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:00 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Volume volume-1c171d88-807f-4c61-8ea7-9783aac566ef (1c171d88-807f-4c61-8ea7-9783aac566ef): created successfully Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237e97d2-97b3-4757-a5af-0c6177b9677d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:00 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Flow 'volume_create_manager' (598d2e28-a464-4705-87d8-9ab56fa81412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-525a0d09-29f5-4c72-8191-00e5f0d7b91b tempest-SnapshotDependencyTests-2003512415 None] Created volume successfully. Sep 01 02:23:01 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.340s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:01 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Deleted volume successfully. Sep 01 02:23:01 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b Sep 01 02:23:01 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a37accac-2379-40f3-98bd-f06f08046e4d tempest-ProjectMemberTests-485697174 None] Lock "cinder-c6ec0cac-3adc-4a3c-9d41-baaae96c59af-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (9b8b54a1-0e09-4f01-af24-d4b3ab876d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d18584-7ca3-4ddf-8a1e-32e1fd2f4e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6d18584-7ca3-4ddf-8a1e-32e1fd2f4e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1865832359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299193a9-d2da-4831-86a3-f85c1be63aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:01Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428d95c5-5039-4e4a-9f0f-73ea817764fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:01 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (428d95c5-5039-4e4a-9f0f-73ea817764fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd4c624-9b1f-4e25-9400-717797d5ade6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd4c624-9b1f-4e25-9400-717797d5ade6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '299193a9-d2da-4831-86a3-f85c1be63aad', 'volume_name': 'volume-299193a9-d2da-4831-86a3-f85c1be63aad', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18e2c70-aaf6-450f-bbaf-8b336b0fb38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18e2c70-aaf6-450f-bbaf-8b336b0fb38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886fbdd8-984e-4b76-b6c0-9c882522f153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:01 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Volume 299193a9-d2da-4831-86a3-f85c1be63aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-299193a9-d2da-4831-86a3-f85c1be63aad', 'volume_size': 1} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1865832359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=299193a9-d2da-4831-86a3-f85c1be63aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:01Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Creating volume 299193a9-d2da-4831-86a3-f85c1be63aad {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:01 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b" returned: 0 in 0.462s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:01 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad 1073741824 Sep 01 02:23:01 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:01 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b Sep 01 02:23:01 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:01 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d7d87a28-d32f-478c-baa0-a126e7a3a94b" returned: 0 in 0.251s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-d7d87a28-d32f-478c-baa0-a126e7a3a94b" released by "delete_volume" :: held 0.785s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Created reservations ['c2fe769b-eae6-4bea-af64-b500a91d8ef3', 'ecdca6d5-e798-46c9-abd4-c82453270d6e', 'f07a8f44-2699-4273-b565-423cdfeb4da3', 'be8d4e0b-7368-40bf-923e-2311d1cd23bb'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:01 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:01 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:01 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad 1073741824" returned: 0 in 0.452s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:01 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad Sep 01 02:23:01 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:02 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.298s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:02 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Deleted volume successfully. Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-43c7f128-d46b-40f6-879f-e278d65e1515 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-d7d87a28-d32f-478c-baa0-a126e7a3a94b-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:02 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad" returned: 0 in 0.290s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (886fbdd8-984e-4b76-b6c0-9c882522f153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-299193a9-d2da-4831-86a3-f85c1be63aad', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab793c0-dee7-45eb-9e2a-bc46713458b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Volume volume-299193a9-d2da-4831-86a3-f85c1be63aad (299193a9-d2da-4831-86a3-f85c1be63aad): created successfully Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ab793c0-dee7-45eb-9e2a-bc46713458b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (9b8b54a1-0e09-4f01-af24-d4b3ab876d4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:02 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-98829d44-c720-43a7-bf6a-292d308c16d4 tempest-ProjectMemberTests-485697174 None] Created volume successfully. Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] Creating offline snapshot a060d88b-d805-431e-a5fd-0bdf620e0741 of volume 1c171d88-807f-4c61-8ea7-9783aac566ef {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Flow 'volume_create_manager' (33f95b52-5473-4e5b-b554-96a7a39beb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f830929-3209-444c-bd3d-6ffad9fb1065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[c166e229-cd56-4100-9250-f6befa68c6c5]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f830929-3209-444c-bd3d-6ffad9fb1065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1422127822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e486782d804c769cc5ae2a9179bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:03Z,use_quota=True,user_id='fa45bd91be0f465ea7656f6d2565f570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8913d24-1818-42fe-a1df-887e14972c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8913d24-1818-42fe-a1df-887e14972c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9794f0c0-a5b6-48f0-a641-b5395a132320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9794f0c0-a5b6-48f0-a641-b5395a132320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e', 'volume_name': 'volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e15cde-a38f-4063-8dd2-bbfda727c687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e15cde-a38f-4063-8dd2-bbfda727c687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba79f1e6-23b0-4b60-9ee8-a99a64a33d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:02 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Volume 862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e', 'volume_size': 1} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:02 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef Sep 01 02:23:02 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:03 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef" returned: 0 in 0.365s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:03 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 1G Sep 01 02:23:03 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:03 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 1G" returned: 0 in 0.392s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c171d88-807f-4c61-8ea7-9783aac566ef -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:03 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c171d88-807f-4c61-8ea7-9783aac566ef -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 Sep 01 02:23:03 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:03 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c171d88-807f-4c61-8ea7-9783aac566ef -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741" returned: 0 in 0.312s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:03 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 is being set with open permissions: ugo+rw Sep 01 02:23:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:03 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 Sep 01 02:23:03 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:03 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741" returned: 0 in 0.253s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.info Sep 01 02:23:04 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.info" returned: 0 in 0.254s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.info is being set with open permissions: ugo+rw Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.info Sep 01 02:23:04 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.info" returned: 0 in 0.264s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.985s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.822s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1422127822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e486782d804c769cc5ae2a9179bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:03Z,use_quota=True,user_id='fa45bd91be0f465ea7656f6d2565f570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Creating volume 862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:04 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:04 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e 1073741824 Sep 01 02:23:04 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:04 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-0c48de69-bd02-493f-a22f-18c1a224edb8 tempest-SnapshotDependencyTests-2003512415 None] Create snapshot completed successfully Sep 01 02:23:04 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e 1073741824" returned: 0 in 0.414s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e Sep 01 02:23:05 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e" returned: 0 in 0.242s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.507s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba79f1e6-23b0-4b60-9ee8-a99a64a33d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ce0eb5-3977-402e-a18d-42be8c18cfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] Creating offline snapshot 6452a804-e565-4ca3-9339-11017ed1cf1b of volume 299193a9-d2da-4831-86a3-f85c1be63aad {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:05 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Volume volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e (862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e): created successfully Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ce0eb5-3977-402e-a18d-42be8c18cfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Flow 'volume_create_manager' (33f95b52-5473-4e5b-b554-96a7a39beb32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b02494d-4026-4b11-ae11-5ede227cf59d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-070963af-053b-47dc-b7f2-0466134f70ee tempest-ProjectReaderTests-1417274899 None] Created volume successfully. Sep 01 02:23:05 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad Sep 01 02:23:05 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad" returned: 0 in 0.392s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:05 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b 1G Sep 01 02:23:05 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:06 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b 1G" returned: 0 in 0.483s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-299193a9-d2da-4831-86a3-f85c1be63aad -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-299193a9-d2da-4831-86a3-f85c1be63aad -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b Sep 01 02:23:06 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Flow 'volume_create_manager' (2bf85f80-611f-4e9e-804f-4acdcd0cf4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3604e328-812a-46aa-ae32-f023f054d580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3604e328-812a-46aa-ae32-f023f054d580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc67999-274c-4b3c-a93a-46f27a37971d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6c2c662493746d0848e3cee858b48d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a060d88b-d805-431e-a5fd-0bdf620e0741,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:06Z,use_quota=True,user_id='df8f2a7392bb4781874addb5e1d949f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58921cc2-0831-4e34-a08c-85f08197a973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58921cc2-0831-4e34-a08c-85f08197a973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c235c7fd-c992-4786-ad24-cc6c6de1fbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c235c7fd-c992-4786-ad24-cc6c6de1fbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0cc67999-274c-4b3c-a93a-46f27a37971d', 'volume_name': 'volume-0cc67999-274c-4b3c-a93a-46f27a37971d', 'volume_size': 1, 'snapshot_id': 'a060d88b-d805-431e-a5fd-0bdf620e0741'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae136376-c4f3-4340-be22-cdf995bcb0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae136376-c4f3-4340-be22-cdf995bcb0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5cb09bd-c0ba-44d9-abf5-9b309b25ba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:06 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Volume 0cc67999-274c-4b3c-a93a-46f27a37971d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0cc67999-274c-4b3c-a93a-46f27a37971d', 'volume_size': 1, 'snapshot_id': 'a060d88b-d805-431e-a5fd-0bdf620e0741'} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:06 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-299193a9-d2da-4831-86a3-f85c1be63aad -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b" returned: 0 in 0.296s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b is being set with open permissions: ugo+rw Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b Sep 01 02:23:06 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:06 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b" returned: 0 in 0.239s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:06 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:06 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.info Sep 01 02:23:06 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.info" returned: 0 in 0.250s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.info is being set with open permissions: ugo+rw Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:07 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.info Sep 01 02:23:07 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.info" returned: 0 in 0.240s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.413s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] Creating offline snapshot cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 of volume 862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:07 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f408bcd5-66d8-4b4c-ab7e-290c14399a2d tempest-ProjectMemberTests-485697174 None] Create snapshot completed successfully Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[16610706-e844-4c79-a30f-9765f517e7c9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:07 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e Sep 01 02:23:07 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e" returned: 0 in 0.366s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:07 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 1G Sep 01 02:23:07 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-6452a804-e565-4ca3-9339-11017ed1cf1b-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Lock "cinder-6452a804-e565-4ca3-9339-11017ed1cf1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:07 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-299193a9-d2da-4831-86a3-f85c1be63aad" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-299193a9-d2da-4831-86a3-f85c1be63aad" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-6452a804-e565-4ca3-9339-11017ed1cf1b" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-6452a804-e565-4ca3-9339-11017ed1cf1b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Deleting offline snapshot 6452a804-e565-4ca3-9339-11017ed1cf1b of volume 299193a9-d2da-4831-86a3-f85c1be63aad {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] snapshot_file for this snap is: volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b546b4c-d0ed-4ccf-9e40-eb5134df6466]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 1G" returned: 0 in 0.442s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 Sep 01 02:23:08 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b Sep 01 02:23:08 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1" returned: 0 in 0.300s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 is being set with open permissions: ugo+rw Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b" returned: 0 in 0.373s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-299193a9-d2da-4831-86a3-f85c1be63aad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:08 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 Sep 01 02:23:08 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5cd65b-bffc-4a14-8e54-9e30a729342e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad Sep 01 02:23:08 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1" returned: 0 in 0.252s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.info Sep 01 02:23:08 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad" returned: 0 in 0.385s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:08 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b Sep 01 02:23:08 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:08 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.info" returned: 0 in 0.274s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:08 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.info is being set with open permissions: ugo+rw Sep 01 02:23:08 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:09 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.info Sep 01 02:23:09 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:09 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b" returned: 0 in 0.347s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:09 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b Sep 01 02:23:09 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:09 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.info" returned: 0 in 0.270s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.991s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.883s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "cinder-quobyte-a060d88b-d805-431e-a5fd-0bdf620e0741-0cc67999-274c-4b3c-a93a-46f27a37971d" by "_create_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-a060d88b-d805-431e-a5fd-0bdf620e0741-0cc67999-274c-4b3c-a93a-46f27a37971d" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Creating volume 0cc67999-274c-4b3c-a93a-46f27a37971d from snapshot a060d88b-d805-431e-a5fd-0bdf620e0741 {{(pid=87389) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "cinder-quobyte-0cc67999-274c-4b3c-a93a-46f27a37971d" by "_copy_volume_from_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:09 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2d7c65ae-c5ef-4472-8241-871f51dcb52d tempest-ProjectReaderTests-1417274899 None] Create snapshot completed successfully Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-0cc67999-274c-4b3c-a93a-46f27a37971d" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] snapshot: a060d88b-d805-431e-a5fd-0bdf620e0741, volume: 0cc67999-274c-4b3c-a93a-46f27a37971d, {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5445117-9a31-49c0-8c31-63941666b82a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:09 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad.6452a804-e565-4ca3-9339-11017ed1cf1b" returned: 0 in 0.276s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:09 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 Sep 01 02:23:09 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-6452a804-e565-4ca3-9339-11017ed1cf1b" released by "_delete_snapshot" :: held 1.481s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-299193a9-d2da-4831-86a3-f85c1be63aad" released by "delete_snapshot" :: held 1.505s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Created reservations ['13e52aef-1e91-48d5-b1ab-ac103e6b4802', '69e22653-6781-45b6-8b44-371410bb6674', '800156e9-21ab-4023-9f48-64bf04c03f37', '4312797a-d01c-407c-badc-bfa15d60cfcb'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:09 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Delete snapshot completed successfully. Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6e8d6ee0-7be5-40e6-856a-546d71a457c4 tempest-ProjectMemberTests-485697174 None] Lock "cinder-6452a804-e565-4ca3-9339-11017ed1cf1b-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:09 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741" returned: 0 in 0.371s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c171d88-807f-4c61-8ea7-9783aac566ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[64693a8b-b43c-4659-a8a8-bf48685b1504]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:09 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef Sep 01 02:23:09 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Deleting offline snapshot cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 of volume 862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] snapshot_file for this snap is: volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-299193a9-d2da-4831-86a3-f85c1be63aad-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4a1704-f3a5-4b04-846f-0235b310c34e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:10 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Lock "cinder-299193a9-d2da-4831-86a3-f85c1be63aad-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef" returned: 0 in 0.455s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Creating direct copy from snapshot {{(pid=87389) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.utils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Path /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d not found in is_blk_device check {{(pid=87389) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:10 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d Sep 01 02:23:10 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-299193a9-d2da-4831-86a3-f85c1be63aad" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-299193a9-d2da-4831-86a3-f85c1be63aad" acquired by "delete_volume" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:10 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 Sep 01 02:23:10 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7f1afb-12cf-4623-a2d1-8d5d8c069c3d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:10 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad Sep 01 02:23:10 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:10 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1" returned: 0 in 0.399s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d715a80-b857-44ca-a4cb-c0a71fed9b3a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:10 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad" returned: 0 in 0.405s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:10 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e Sep 01 02:23:10 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:10 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad Sep 01 02:23:10 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:11 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e" returned: 0 in 0.792s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:11 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:11 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 Sep 01 02:23:11 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-299193a9-d2da-4831-86a3-f85c1be63aad" returned: 0 in 0.753s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-299193a9-d2da-4831-86a3-f85c1be63aad" released by "delete_volume" :: held 1.253s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:11 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Created reservations ['8d84f2ea-cc63-4862-9cd7-50693688f10c', '58f2cce8-35f4-4f6d-859f-d9ce86e21561', 'e62e8c24-e852-46b8-94c2-e3756f4a7362', '0a3ac995-d3ab-4e65-a227-6b533759eb38'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:11 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:11 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:12 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:12 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1" returned: 0 in 0.931s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.490s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:12 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:12 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Deleted volume successfully. Sep 01 02:23:12 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1 Sep 01 02:23:12 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:12 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-9f312d4f-c60e-40c6-9004-c7cd02c763a6 tempest-ProjectMemberTests-485697174 None] Lock "cinder-299193a9-d2da-4831-86a3-f85c1be63aad-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:12 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e.cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1" returned: 0 in 0.598s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1" released by "_delete_snapshot" :: held 2.891s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e" released by "delete_snapshot" :: held 2.939s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Created reservations ['f7f5ed3b-d1dc-4017-8927-4f4cc8ece736', '25fb3713-b927-4316-ae36-61f184176b0a', '78aeaca7-68ba-4745-8d53-04c3d714c5f4', 'be574dc0-e33b-4ef8-8646-e3297641e35d'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:13 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Delete snapshot completed successfully. Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-ac111e4e-0a53-48c1-b57b-e847c78bfd54 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-cdc297d2-1e4c-4527-8cf3-fa7d8c4407f1-delete_snapshot" released by "delete_snapshot" :: held 3.502s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (891d6e73-b22c-4e82-8f8c-751090991c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0615a7-63e5-43d7-8054-69256861e402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b0615a7-63e5-43d7-8054-69256861e402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710357163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa14bb75-a2f9-457b-94ba-efe766beee2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:14Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a50cdf3-0fa3-4415-b194-435c1ab226cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a50cdf3-0fa3-4415-b194-435c1ab226cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b13ed5-953e-4f83-ae01-8d9f6b2c8ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b13ed5-953e-4f83-ae01-8d9f6b2c8ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa14bb75-a2f9-457b-94ba-efe766beee2f', 'volume_name': 'volume-aa14bb75-a2f9-457b-94ba-efe766beee2f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120c1c5c-b2f3-4a69-adfa-8bfd942b09d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (120c1c5c-b2f3-4a69-adfa-8bfd942b09d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7016658-cdd8-4946-b3fd-1bd6c1154a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:13 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Volume aa14bb75-a2f9-457b-94ba-efe766beee2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa14bb75-a2f9-457b-94ba-efe766beee2f', 'volume_size': 1} Sep 01 02:23:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Lock "cinder-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e" acquired by "delete_volume" :: waited 0.052s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[688d3c61-e95b-485f-97cb-b01b92f38ede]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:15 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d" returned: 0 in 5.126s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.image.image_utils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Image conversion details: src /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d {{(pid=87389) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 01 02:23:15 devstack cinder-volume[87389]: INFO cinder.image.image_utils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Converted 1024.00 MB image at 199.71 MB/s Sep 01 02:23:15 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d is being set with open permissions: ugo+rw Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:15 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e Sep 01 02:23:15 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:15 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d Sep 01 02:23:15 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:15 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d" returned: 0 in 0.259s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:15 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-0cc67999-274c-4b3c-a93a-46f27a37971d" released by "_copy_volume_from_snapshot" :: held 6.296s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e" returned: 0 in 0.439s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:15 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e Sep 01 02:23:15 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-a060d88b-d805-431e-a5fd-0bdf620e0741-0cc67999-274c-4b3c-a93a-46f27a37971d" released by "_create_volume_from_snapshot" :: held 6.381s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.412s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1710357163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa14bb75-a2f9-457b-94ba-efe766beee2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:14Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Creating volume aa14bb75-a2f9-457b-94ba-efe766beee2f {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:15 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:15 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f 1073741824 Sep 01 02:23:15 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5cb09bd-c0ba-44d9-abf5-9b309b25ba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc67999-274c-4b3c-a93a-46f27a37971d', 'volume_size': 1, 'snapshot_id': 'a060d88b-d805-431e-a5fd-0bdf620e0741'}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca6c1ad-14ea-4528-af65-3f4493d43417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:15 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Volume volume-0cc67999-274c-4b3c-a93a-46f27a37971d (0cc67999-274c-4b3c-a93a-46f27a37971d): created successfully Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eca6c1ad-14ea-4528-af65-3f4493d43417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Flow 'volume_create_manager' (2bf85f80-611f-4e9e-804f-4acdcd0cf4cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:15 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-dce49ce9-fdb3-4253-847c-f046c65208a6 tempest-SnapshotDependencyTests-2003512415 None] Created volume successfully. Sep 01 02:23:15 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e" returned: 0 in 0.253s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e" released by "delete_volume" :: held 0.822s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:15 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Created reservations ['1960ec41-5402-441d-8409-a648c6ea47d6', 'bf2a0433-a497-4440-89c1-c0160cd894f5', '956ee9b8-1bdf-4e58-8e0a-482708233244', '55d46bec-bb40-4d51-82a4-37d02015b2e8'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:16 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:16 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:16 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f 1073741824" returned: 0 in 0.493s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:16 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f Sep 01 02:23:16 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:16 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.277s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:16 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Deleted volume successfully. Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4dc83262-8a2d-476d-84f9-dbde5c2044ee tempest-ProjectReaderTests-1417274899 None] Lock "cinder-862b4bbf-a2d2-471b-af4f-f8e7e1a8a00e-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "cinder-a060d88b-d805-431e-a5fd-0bdf620e0741-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-a060d88b-d805-431e-a5fd-0bdf620e0741-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "cinder-quobyte-1c171d88-807f-4c61-8ea7-9783aac566ef" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-1c171d88-807f-4c61-8ea7-9783aac566ef" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "cinder-quobyte-a060d88b-d805-431e-a5fd-0bdf620e0741" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-a060d88b-d805-431e-a5fd-0bdf620e0741" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Deleting offline snapshot a060d88b-d805-431e-a5fd-0bdf620e0741 of volume 1c171d88-807f-4c61-8ea7-9783aac566ef {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] snapshot_file for this snap is: volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:16 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa2cf0f-598f-4567-bbcb-c9c13728ee35]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f" returned: 0 in 0.295s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7016658-cdd8-4946-b3fd-1bd6c1154a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa14bb75-a2f9-457b-94ba-efe766beee2f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50d88f7-24e4-4b2b-ab0a-2824a1bbf5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:16 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Volume volume-aa14bb75-a2f9-457b-94ba-efe766beee2f (aa14bb75-a2f9-457b-94ba-efe766beee2f): created successfully Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e50d88f7-24e4-4b2b-ab0a-2824a1bbf5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (891d6e73-b22c-4e82-8f8c-751090991c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:16 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-39def486-2cc4-4e94-a168-75ba9e28041c tempest-ProjectMemberTests-485697174 None] Created volume successfully. Sep 01 02:23:16 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 Sep 01 02:23:16 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Flow 'volume_create_manager' (5bd22b49-b068-4289-9aa9-11ce492c36db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72b2df0-8df2-47d2-aa71-ccaf74913b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c72b2df0-8df2-47d2-aa71-ccaf74913b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734581999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f51aec6-dcd4-4183-b091-0461e00099fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e486782d804c769cc5ae2a9179bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:17Z,use_quota=True,user_id='fa45bd91be0f465ea7656f6d2565f570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5f94d1-08b0-4dc8-a8ce-87ec89ca9b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a5f94d1-08b0-4dc8-a8ce-87ec89ca9b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd0f558-d0ad-4f36-b217-61147d2c0304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd0f558-d0ad-4f36-b217-61147d2c0304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f51aec6-dcd4-4183-b091-0461e00099fa', 'volume_name': 'volume-9f51aec6-dcd4-4183-b091-0461e00099fa', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a999e34-ab4e-4278-bf16-ff2ed14a587d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a999e34-ab4e-4278-bf16-ff2ed14a587d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89371ecf-b0e4-452d-adbd-5e0bdd51d63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:16 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Volume 9f51aec6-dcd4-4183-b091-0461e00099fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f51aec6-dcd4-4183-b091-0461e00099fa', 'volume_size': 1} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1734581999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f51aec6-dcd4-4183-b091-0461e00099fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e486782d804c769cc5ae2a9179bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:17Z,use_quota=True,user_id='fa45bd91be0f465ea7656f6d2565f570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Creating volume 9f51aec6-dcd4-4183-b091-0461e00099fa {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:16 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:16 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa 1073741824 Sep 01 02:23:16 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:16 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741" returned: 0 in 0.432s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c171d88-807f-4c61-8ea7-9783aac566ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[31eb9ce5-d811-451c-a2f9-7346ca7bc33f]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:16 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:17 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef Sep 01 02:23:17 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:17 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa 1073741824" returned: 0 in 0.462s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:17 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa Sep 01 02:23:17 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:17 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef" returned: 0 in 0.571s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:17 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 Sep 01 02:23:17 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:17 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa" returned: 0 in 0.263s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.537s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89371ecf-b0e4-452d-adbd-5e0bdd51d63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f51aec6-dcd4-4183-b091-0461e00099fa', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b7e413-1cc9-455c-98c4-6709ffb0e719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] Creating offline snapshot 8b256cb4-c597-4e35-820f-fb7d94b77aa5 of volume aa14bb75-a2f9-457b-94ba-efe766beee2f {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:17 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Volume volume-9f51aec6-dcd4-4183-b091-0461e00099fa (9f51aec6-dcd4-4183-b091-0461e00099fa): created successfully Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83b7e413-1cc9-455c-98c4-6709ffb0e719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Flow 'volume_create_manager' (5bd22b49-b068-4289-9aa9-11ce492c36db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[041f37a4-c17f-425b-bf9b-c762b69d3c10]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:17 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b35eb6d7-17a8-41e7-b65d-44a8d60fea4b tempest-ProjectReaderTests-1417274899 None] Created volume successfully. Sep 01 02:23:17 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f Sep 01 02:23:17 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:17 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741" returned: 0 in 0.369s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:17 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:17 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741 Sep 01 02:23:17 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:18 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f" returned: 0 in 0.404s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:18 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 1G Sep 01 02:23:18 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:18 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef.a060d88b-d805-431e-a5fd-0bdf620e0741" returned: 0 in 0.252s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-a060d88b-d805-431e-a5fd-0bdf620e0741" released by "_delete_snapshot" :: held 1.734s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-1c171d88-807f-4c61-8ea7-9783aac566ef" released by "delete_snapshot" :: held 1.768s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Created reservations ['42cc44e9-a5e3-4d55-9356-87c7aa41a978', 'd6510190-8341-4299-974c-b6e1111fe031', '94228d73-f22f-42db-94eb-fffb1859829c', 'f153ee82-7e69-4a1f-9212-b2193eea6206'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:18 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Delete snapshot completed successfully. Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-f2e274fc-9214-4f82-9d62-6a50c30a8c0e tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-a060d88b-d805-431e-a5fd-0bdf620e0741-delete_snapshot" released by "delete_snapshot" :: held 1.908s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:18 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 1G" returned: 0 in 0.405s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa14bb75-a2f9-457b-94ba-efe766beee2f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:18 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa14bb75-a2f9-457b-94ba-efe766beee2f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 Sep 01 02:23:18 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "cinder-1c171d88-807f-4c61-8ea7-9783aac566ef-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-1c171d88-807f-4c61-8ea7-9783aac566ef-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "cinder-quobyte-1c171d88-807f-4c61-8ea7-9783aac566ef" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-1c171d88-807f-4c61-8ea7-9783aac566ef" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7da7e19-564e-4f1a-8829-b49c160259d2]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:18 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef Sep 01 02:23:18 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:18 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa14bb75-a2f9-457b-94ba-efe766beee2f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5" returned: 0 in 0.344s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:18 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 is being set with open permissions: ugo+rw Sep 01 02:23:18 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:18 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 Sep 01 02:23:18 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:19 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef" returned: 0 in 0.413s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef Sep 01 02:23:19 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:19 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5" returned: 0 in 0.294s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.info Sep 01 02:23:19 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:19 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-1c171d88-807f-4c61-8ea7-9783aac566ef" returned: 0 in 0.261s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-1c171d88-807f-4c61-8ea7-9783aac566ef" released by "delete_volume" :: held 0.738s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:19 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.info" returned: 0 in 0.262s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:19 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.info is being set with open permissions: ugo+rw Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Created reservations ['39cbf822-e34e-48ee-8544-05df49e3c5bc', '9e5066a1-c652-425a-9e48-3bb60fd4b909', '6024dc3d-80f3-4fd5-b30d-8a182a673e10', '2af91a49-b50e-40f8-8505-6e2488f85434'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:19 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.info Sep 01 02:23:19 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:19 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "cinder-0cc67999-274c-4b3c-a93a-46f27a37971d-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:19 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.info" returned: 0 in 0.310s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.140s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.723s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:19 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-0cc67999-274c-4b3c-a93a-46f27a37971d-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.278s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] Creating offline snapshot 7677b4ba-6684-471c-94c7-bc307c71b514 of volume 9f51aec6-dcd4-4183-b091-0461e00099fa {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Deleted volume successfully. Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[60046406-266d-4ffa-9583-98fabb5d0f29]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e305536b-e9bf-47a3-bf88-fe571abfd964 tempest-ProjectMemberTests-485697174 None] Create snapshot completed successfully Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "cinder-quobyte-0cc67999-274c-4b3c-a93a-46f27a37971d" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-7c59e002-6049-49d3-8335-ac0f8a68b3df tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-1c171d88-807f-4c61-8ea7-9783aac566ef-delete_volume" released by "delete_volume" :: held 1.304s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-0cc67999-274c-4b3c-a93a-46f27a37971d" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[211fa8b0-4c8e-4f3b-b1b8-a01e2035f04a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:19 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:19 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa Sep 01 02:23:19 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:20 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d Sep 01 02:23:20 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:20 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa" returned: 0 in 0.397s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-8b256cb4-c597-4e35-820f-fb7d94b77aa5-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:20 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 1G Sep 01 02:23:20 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Lock "cinder-8b256cb4-c597-4e35-820f-fb7d94b77aa5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-aa14bb75-a2f9-457b-94ba-efe766beee2f" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-aa14bb75-a2f9-457b-94ba-efe766beee2f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-8b256cb4-c597-4e35-820f-fb7d94b77aa5" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-8b256cb4-c597-4e35-820f-fb7d94b77aa5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Deleting offline snapshot 8b256cb4-c597-4e35-820f-fb7d94b77aa5 of volume aa14bb75-a2f9-457b-94ba-efe766beee2f {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] snapshot_file for this snap is: volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1b3ffc-7d9a-4af1-8ca7-ad69ef3d12a0]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:20 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d" returned: 0 in 0.452s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:20 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d Sep 01 02:23:20 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:20 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 Sep 01 02:23:20 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:20 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 1G" returned: 0 in 0.417s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f51aec6-dcd4-4183-b091-0461e00099fa -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:20 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-0cc67999-274c-4b3c-a93a-46f27a37971d" returned: 0 in 0.292s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:20 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f51aec6-dcd4-4183-b091-0461e00099fa -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 Sep 01 02:23:20 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-quobyte-0cc67999-274c-4b3c-a93a-46f27a37971d" released by "delete_volume" :: held 0.793s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Created reservations ['535c4588-c483-42e9-b0bd-d000c0333576', '9b7e7141-db85-4af1-9018-57532eb88db9', 'b2e990f6-1ec0-4379-bd2c-7e81b9e88744', 'f4e4b138-f43a-4a21-a613-733d240949e7'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:20 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5" returned: 0 in 0.424s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa14bb75-a2f9-457b-94ba-efe766beee2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fe2046-0171-4ab2-ba11-3303cd51a63e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:20 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:20 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:20 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f Sep 01 02:23:21 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f51aec6-dcd4-4183-b091-0461e00099fa -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514" returned: 0 in 0.357s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:21 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 is being set with open permissions: ugo+rw Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:21 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 Sep 01 02:23:21 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.302s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:21 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Deleted volume successfully. Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-05cbf1ba-3825-456a-b4ec-c0f99cfd44f2 tempest-SnapshotDependencyTests-2003512415 None] Lock "cinder-0cc67999-274c-4b3c-a93a-46f27a37971d-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:21 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:21 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f" returned: 0 in 0.506s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:21 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.info Sep 01 02:23:21 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 Sep 01 02:23:21 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.info" returned: 0 in 0.298s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:21 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.info is being set with open permissions: ugo+rw Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:21 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.info Sep 01 02:23:21 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5" returned: 0 in 0.426s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:21 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5 Sep 01 02:23:21 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:21 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.info" returned: 0 in 0.315s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:21 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.192s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:22 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d91a414d-e9aa-4ee4-8a69-f9e676baef06 tempest-ProjectReaderTests-1417274899 None] Create snapshot completed successfully Sep 01 02:23:22 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f.8b256cb4-c597-4e35-820f-fb7d94b77aa5" returned: 0 in 0.286s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-8b256cb4-c597-4e35-820f-fb7d94b77aa5" released by "_delete_snapshot" :: held 1.767s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-aa14bb75-a2f9-457b-94ba-efe766beee2f" released by "delete_snapshot" :: held 1.800s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Created reservations ['561bcc28-0e48-403e-ae6e-c256ad2e2a6c', 'a67cf64f-3aa7-408c-922b-6c2d0e99a939', '2d800d83-b974-46f2-84cf-04cffb152f4e', '73cabb85-72e5-4df1-9aea-c815375c8fe4'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:22 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Delete snapshot completed successfully. Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-d6eb95d5-da50-4e81-b400-eaf4e2696840 tempest-ProjectMemberTests-485697174 None] Lock "cinder-8b256cb4-c597-4e35-820f-fb7d94b77aa5-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-7677b4ba-6684-471c-94c7-bc307c71b514-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-7677b4ba-6684-471c-94c7-bc307c71b514-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-9f51aec6-dcd4-4183-b091-0461e00099fa" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-9f51aec6-dcd4-4183-b091-0461e00099fa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-7677b4ba-6684-471c-94c7-bc307c71b514" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-7677b4ba-6684-471c-94c7-bc307c71b514" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Deleting offline snapshot 7677b4ba-6684-471c-94c7-bc307c71b514 of volume 9f51aec6-dcd4-4183-b091-0461e00099fa {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] snapshot_file for this snap is: volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7791efe0-a8ec-4b46-8d3b-e3e241c1a378]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-aa14bb75-a2f9-457b-94ba-efe766beee2f-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Lock "cinder-aa14bb75-a2f9-457b-94ba-efe766beee2f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:22 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 Sep 01 02:23:22 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-aa14bb75-a2f9-457b-94ba-efe766beee2f" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-aa14bb75-a2f9-457b-94ba-efe766beee2f" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc74772c-d109-4e97-abac-4140e22b57b1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:22 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f Sep 01 02:23:22 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:22 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514" returned: 0 in 0.467s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f51aec6-dcd4-4183-b091-0461e00099fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c599606-c3bd-44ad-b84a-c0f687fd2138]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:22 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:23 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f" returned: 0 in 0.402s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:23 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa Sep 01 02:23:23 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:23 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f Sep 01 02:23:23 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:23 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa14bb75-a2f9-457b-94ba-efe766beee2f" returned: 0 in 0.247s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-aa14bb75-a2f9-457b-94ba-efe766beee2f" released by "delete_volume" :: held 0.716s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:23 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa" returned: 0 in 0.379s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:23 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 Sep 01 02:23:23 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Created reservations ['6def0fd3-8897-4873-b5ba-971194142ec4', 'c5fb2f1d-1bae-4671-8d1e-3ab1fd13b506', 'ced709b1-5f84-4e57-b3f0-2de554e49150', 'd2bb3c78-608b-4818-af19-273549cd8618'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:23 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:23 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:23 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514" returned: 0 in 0.419s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:23 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.300s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:23 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Deleted volume successfully. Sep 01 02:23:23 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514 Sep 01 02:23:23 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:23 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-cf96b786-cf93-4fca-8591-77779e5990f3 tempest-ProjectMemberTests-485697174 None] Lock "cinder-aa14bb75-a2f9-457b-94ba-efe766beee2f-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:24 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa.7677b4ba-6684-471c-94c7-bc307c71b514" returned: 0 in 0.310s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-7677b4ba-6684-471c-94c7-bc307c71b514" released by "_delete_snapshot" :: held 1.700s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-9f51aec6-dcd4-4183-b091-0461e00099fa" released by "delete_snapshot" :: held 1.725s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Created reservations ['d6742526-c2e1-46af-86b7-4c10b43cae29', '134c5a51-07b5-497b-ab1d-16c2a1432c00', '31ec54ee-6c99-4609-a2c4-0f7133cebe79', '806e0ce9-b09c-4249-861c-faeaa00040a9'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (337a9382-f19c-4e9e-8d17-9c8d255ed037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71160a8f-e717-441a-a553-58bb4c640e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:24 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Delete snapshot completed successfully. Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71160a8f-e717-441a-a553-58bb4c640e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1392611787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ae74d2-59de-4ba9-97eb-e72a1856083d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:24Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9874f59-fafd-4a56-b961-bf70e60464d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9874f59-fafd-4a56-b961-bf70e60464d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d13c08-1509-4433-b4cf-d0c6622b234c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d13c08-1509-4433-b4cf-d0c6622b234c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ae74d2-59de-4ba9-97eb-e72a1856083d', 'volume_name': 'volume-12ae74d2-59de-4ba9-97eb-e72a1856083d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63189b82-b189-46b4-aa38-b8574abf77a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63189b82-b189-46b4-aa38-b8574abf77a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ff17d7-53a0-4aa5-b0e3-1ad5949501b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:24 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Volume 12ae74d2-59de-4ba9-97eb-e72a1856083d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ae74d2-59de-4ba9-97eb-e72a1856083d', 'volume_size': 1} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1392611787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ae74d2-59de-4ba9-97eb-e72a1856083d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:24Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Creating volume 12ae74d2-59de-4ba9-97eb-e72a1856083d {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:24 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-6afaf664-b415-4dc7-a02e-75aadebcf949 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-7677b4ba-6684-471c-94c7-bc307c71b514-delete_snapshot" released by "delete_snapshot" :: held 1.965s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:24 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d 1073741824 Sep 01 02:23:24 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-9f51aec6-dcd4-4183-b091-0461e00099fa-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-9f51aec6-dcd4-4183-b091-0461e00099fa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-9f51aec6-dcd4-4183-b091-0461e00099fa" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-9f51aec6-dcd4-4183-b091-0461e00099fa" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf50a50-88fd-4a0e-8c70-945df469d778]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:24 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d 1073741824" returned: 0 in 0.469s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:24 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa Sep 01 02:23:24 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:24 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:24 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d Sep 01 02:23:24 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:25 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa" returned: 0 in 0.498s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:25 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d" returned: 0 in 0.356s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:25 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ff17d7-53a0-4aa5-b0e3-1ad5949501b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ae74d2-59de-4ba9-97eb-e72a1856083d', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:25 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c8f119-c5de-471e-b9a3-e04e228cc529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:25 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Volume volume-12ae74d2-59de-4ba9-97eb-e72a1856083d (12ae74d2-59de-4ba9-97eb-e72a1856083d): created successfully Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4c8f119-c5de-471e-b9a3-e04e228cc529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (337a9382-f19c-4e9e-8d17-9c8d255ed037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-27fd8cf1-dd15-4504-99c3-98df47d743a4 tempest-ProjectMemberTests-485697174 None] Created volume successfully. Sep 01 02:23:25 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9f51aec6-dcd4-4183-b091-0461e00099fa" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-9f51aec6-dcd4-4183-b091-0461e00099fa" released by "delete_volume" :: held 0.828s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Created reservations ['c14fcddd-5a30-4293-b52c-a4731bfa71c8', 'fb45c121-da59-4ba0-af5f-ae406ecc497e', '4cc20e5f-1681-40e0-8424-0a3826ae4daf', '4efe5bbb-7c6f-4d80-99ce-cba194624468'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:25 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:25 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:25 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.320s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:25 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Deleted volume successfully. Sep 01 02:23:25 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3fda6b7b-cbab-423d-a329-d3daa1ed09a8 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-9f51aec6-dcd4-4183-b091-0461e00099fa-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Flow 'volume_create_manager' (05be5388-fb69-4be8-850c-896f634abe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc78a29-0467-4947-80f1-e755163de306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cc78a29-0467-4947-80f1-e755163de306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564011359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50ba497-4448-4064-87f1-12749e4dcae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e486782d804c769cc5ae2a9179bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:26Z,use_quota=True,user_id='fa45bd91be0f465ea7656f6d2565f570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8915c0-6c07-4cbf-95d0-6718bf61b7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8915c0-6c07-4cbf-95d0-6718bf61b7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bb5b61-59a8-43b9-bd21-cc8c7855f4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8bb5b61-59a8-43b9-bd21-cc8c7855f4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd50ba497-4448-4064-87f1-12749e4dcae3', 'volume_name': 'volume-d50ba497-4448-4064-87f1-12749e4dcae3', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997fa796-dbba-4722-8f18-8754f4610767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (997fa796-dbba-4722-8f18-8754f4610767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29644b0-ba6c-4461-9f56-b1e1fe54bbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:26 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Volume d50ba497-4448-4064-87f1-12749e4dcae3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d50ba497-4448-4064-87f1-12749e4dcae3', 'volume_size': 1} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564011359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d50ba497-4448-4064-87f1-12749e4dcae3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93e486782d804c769cc5ae2a9179bb4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:26Z,use_quota=True,user_id='fa45bd91be0f465ea7656f6d2565f570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Creating volume d50ba497-4448-4064-87f1-12749e4dcae3 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:26 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:26 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 1073741824 Sep 01 02:23:26 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:26 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 1073741824" returned: 0 in 0.502s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:26 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:26 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 Sep 01 02:23:26 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:27 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3" returned: 0 in 0.268s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.738s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c29644b0-ba6c-4461-9f56-b1e1fe54bbc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d50ba497-4448-4064-87f1-12749e4dcae3', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619135ad-3c17-4009-9a9a-1777039380e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] Creating offline snapshot 902f6c47-0b6a-4dcf-80b7-518e6a30b845 of volume 12ae74d2-59de-4ba9-97eb-e72a1856083d {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:27 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Volume volume-d50ba497-4448-4064-87f1-12749e4dcae3 (d50ba497-4448-4064-87f1-12749e4dcae3): created successfully Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (619135ad-3c17-4009-9a9a-1777039380e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Flow 'volume_create_manager' (05be5388-fb69-4be8-850c-896f634abe0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b88580-3ca4-4517-b6bb-ea8f3d2cc7e6]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:27 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-d79f3ca4-26c3-4012-a7fa-b9131e161f35 tempest-ProjectReaderTests-1417274899 None] Created volume successfully. Sep 01 02:23:27 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d Sep 01 02:23:27 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:27 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d" returned: 0 in 0.436s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:27 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:27 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 1G Sep 01 02:23:27 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:28 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 1G" returned: 0 in 0.415s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ae74d2-59de-4ba9-97eb-e72a1856083d -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:28 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ae74d2-59de-4ba9-97eb-e72a1856083d -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 Sep 01 02:23:28 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:28 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ae74d2-59de-4ba9-97eb-e72a1856083d -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845" returned: 0 in 0.369s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:28 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 is being set with open permissions: ugo+rw Sep 01 02:23:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:28 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 Sep 01 02:23:28 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:28 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845" returned: 0 in 0.332s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:28 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:28 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.info Sep 01 02:23:28 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:29 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.info" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:29 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.info is being set with open permissions: ugo+rw Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:29 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.info Sep 01 02:23:29 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:29 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.info" returned: 0 in 0.245s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.178s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.803s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] Creating offline snapshot 668b8a2c-9c88-49b8-bf3a-262c52fe470e of volume d50ba497-4448-4064-87f1-12749e4dcae3 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:29 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-40897067-9b4e-43d5-9680-8cbfc184551e tempest-ProjectMemberTests-485697174 None] Create snapshot completed successfully Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b9ee2c-9b48-4040-9b2e-693dfacf5f6e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:29 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 Sep 01 02:23:29 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-902f6c47-0b6a-4dcf-80b7-518e6a30b845-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Lock "cinder-902f6c47-0b6a-4dcf-80b7-518e6a30b845-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-12ae74d2-59de-4ba9-97eb-e72a1856083d" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-12ae74d2-59de-4ba9-97eb-e72a1856083d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-902f6c47-0b6a-4dcf-80b7-518e6a30b845" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-902f6c47-0b6a-4dcf-80b7-518e6a30b845" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Deleting offline snapshot 902f6c47-0b6a-4dcf-80b7-518e6a30b845 of volume 12ae74d2-59de-4ba9-97eb-e72a1856083d {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] snapshot_file for this snap is: volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[843ad553-f2ee-4c2c-920f-9e7015f38c3e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:29 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3" returned: 0 in 0.396s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:29 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:29 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e 1G Sep 01 02:23:29 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:29 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 Sep 01 02:23:29 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:30 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845" returned: 0 in 0.468s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12ae74d2-59de-4ba9-97eb-e72a1856083d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12631b4-c2c6-473e-92ef-ef8cf5e27943]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:30 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e 1G" returned: 0 in 0.523s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50ba497-4448-4064-87f1-12749e4dcae3 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:30 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50ba497-4448-4064-87f1-12749e4dcae3 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e Sep 01 02:23:30 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:30 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d Sep 01 02:23:30 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:30 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:30 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d" returned: 0 in 0.398s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d50ba497-4448-4064-87f1-12749e4dcae3 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e" returned: 0 in 0.352s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:30 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e is being set with open permissions: ugo+rw Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:30 devstack sudo[106358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 Sep 01 02:23:30 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:30 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e Sep 01 02:23:30 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:30 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e" returned: 0 in 0.285s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:30 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:31 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.info Sep 01 02:23:31 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:31 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845" returned: 0 in 0.408s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:31 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845 Sep 01 02:23:31 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:31 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.info" returned: 0 in 0.280s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:31 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.info is being set with open permissions: ugo+rw Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:31 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.info Sep 01 02:23:31 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:31 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d.902f6c47-0b6a-4dcf-80b7-518e6a30b845" returned: 0 in 0.267s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-902f6c47-0b6a-4dcf-80b7-518e6a30b845" released by "_delete_snapshot" :: held 1.662s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-12ae74d2-59de-4ba9-97eb-e72a1856083d" released by "delete_snapshot" :: held 1.687s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Created reservations ['68265b13-f4bc-4f8a-b9d2-ce9f70d2d0d6', '08b04cb7-e3bc-46ba-8875-f425c27a0da7', 'ce3f8f7e-4327-4e71-958c-f09b81aed653', 'b507e785-1442-4f86-b136-23edd886c624'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:31 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Delete snapshot completed successfully. Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-66070ef6-ce35-42eb-8e48-b4894e66cb70 tempest-ProjectMemberTests-485697174 None] Lock "cinder-902f6c47-0b6a-4dcf-80b7-518e6a30b845-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:31 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.info" returned: 0 in 0.312s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:31 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6d982cff-c040-4601-a4fd-21c8564a855c tempest-ProjectReaderTests-1417274899 None] Create snapshot completed successfully Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-12ae74d2-59de-4ba9-97eb-e72a1856083d-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Lock "cinder-12ae74d2-59de-4ba9-97eb-e72a1856083d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-12ae74d2-59de-4ba9-97eb-e72a1856083d" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-12ae74d2-59de-4ba9-97eb-e72a1856083d" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[889bc5e1-035e-47b7-829f-252bfe7e1fb9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:31 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:32 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d Sep 01 02:23:32 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:32 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d" returned: 0 in 0.376s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:32 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d Sep 01 02:23:32 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:32 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-12ae74d2-59de-4ba9-97eb-e72a1856083d" returned: 0 in 0.307s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-12ae74d2-59de-4ba9-97eb-e72a1856083d" released by "delete_volume" :: held 0.763s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Created reservations ['670a6113-8f3e-4ab0-bfff-833f3e206b0c', 'b589c01f-1ca8-461a-9072-48636cc7355a', 'ab1fdadb-843b-45c9-a3fb-dc044352df2a', '2bd6fbb1-e0a9-4eea-8461-f01ed419fbd8'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-668b8a2c-9c88-49b8-bf3a-262c52fe470e-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-668b8a2c-9c88-49b8-bf3a-262c52fe470e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-d50ba497-4448-4064-87f1-12749e4dcae3" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-d50ba497-4448-4064-87f1-12749e4dcae3" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-668b8a2c-9c88-49b8-bf3a-262c52fe470e" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-668b8a2c-9c88-49b8-bf3a-262c52fe470e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Deleting offline snapshot 668b8a2c-9c88-49b8-bf3a-262c52fe470e of volume d50ba497-4448-4064-87f1-12749e4dcae3 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] snapshot_file for this snap is: volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4cb1d0-1653-4bbc-a6c4-ad28987bcd17]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:32 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:32 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:32 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:33 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e Sep 01 02:23:33 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:33 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.280s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:33 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Deleted volume successfully. Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-28ba55e7-82fd-41ad-a782-6fd1733b1be1 tempest-ProjectMemberTests-485697174 None] Lock "cinder-12ae74d2-59de-4ba9-97eb-e72a1856083d-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:33 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e" returned: 0 in 0.450s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d50ba497-4448-4064-87f1-12749e4dcae3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[efce045c-9bd7-41f0-9b00-9779012d13b8]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:33 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 Sep 01 02:23:33 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (8cb6647c-715e-4148-bb41-0a70fe960ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4811868-49f4-423a-8449-a7f62c2d2713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4811868-49f4-423a-8449-a7f62c2d2713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738020223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eba357c-1eb8-464a-86ef-1ea962a96028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:33Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22998a5b-57e6-4a71-a7a2-5868ff7f3127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22998a5b-57e6-4a71-a7a2-5868ff7f3127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606ab2b8-3bc4-4364-b96e-0c03f86514df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (606ab2b8-3bc4-4364-b96e-0c03f86514df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eba357c-1eb8-464a-86ef-1ea962a96028', 'volume_name': 'volume-8eba357c-1eb8-464a-86ef-1ea962a96028', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a49c6f-a6ae-41e1-925f-5ef94c7ad6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a49c6f-a6ae-41e1-925f-5ef94c7ad6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc7527f-d983-4b25-bb03-ac734499ccbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:33 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Volume 8eba357c-1eb8-464a-86ef-1ea962a96028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eba357c-1eb8-464a-86ef-1ea962a96028', 'volume_size': 1} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1738020223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eba357c-1eb8-464a-86ef-1ea962a96028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:33Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Creating volume 8eba357c-1eb8-464a-86ef-1ea962a96028 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:33 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:33 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 1073741824 Sep 01 02:23:33 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:33 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3" returned: 0 in 0.350s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:33 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:33 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e Sep 01 02:23:33 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:34 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 1073741824" returned: 0 in 0.419s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:34 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 Sep 01 02:23:34 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:34 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e" returned: 0 in 0.381s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:34 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e Sep 01 02:23:34 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:34 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028" returned: 0 in 0.254s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc7527f-d983-4b25-bb03-ac734499ccbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eba357c-1eb8-464a-86ef-1ea962a96028', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01b1efd-b7c4-4a4a-9b6d-e5b8e75e4daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:34 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Volume volume-8eba357c-1eb8-464a-86ef-1ea962a96028 (8eba357c-1eb8-464a-86ef-1ea962a96028): created successfully Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c01b1efd-b7c4-4a4a-9b6d-e5b8e75e4daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (8cb6647c-715e-4148-bb41-0a70fe960ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:34 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8ef889db-70f5-4447-a767-334af38f3166 tempest-ProjectMemberTests-485697174 None] Created volume successfully. Sep 01 02:23:34 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3.668b8a2c-9c88-49b8-bf3a-262c52fe470e" returned: 0 in 0.273s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-668b8a2c-9c88-49b8-bf3a-262c52fe470e" released by "_delete_snapshot" :: held 1.592s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-d50ba497-4448-4064-87f1-12749e4dcae3" released by "delete_snapshot" :: held 1.625s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Created reservations ['4601c149-7761-4e57-93c2-26ad1bcfa7fa', 'b66dd685-05a1-4882-ba70-7f0a614bff03', '4b6ef459-d77d-49a3-afad-d3b4c89abc40', 'f32581b9-5817-414f-a717-2b844aac8c6f'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:34 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Delete snapshot completed successfully. Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b0f51a08-d2c0-4e70-bcd5-4050d274e052 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-668b8a2c-9c88-49b8-bf3a-262c52fe470e-delete_snapshot" released by "delete_snapshot" :: held 1.847s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] Creating offline snapshot dd7687c3-1ef4-464b-b70f-9a3dd437aa16 of volume 8eba357c-1eb8-464a-86ef-1ea962a96028 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee652a7f-c35b-4694-94b9-cb9d92c9ffb1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:34 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 Sep 01 02:23:34 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:34 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-d50ba497-4448-4064-87f1-12749e4dcae3-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-d50ba497-4448-4064-87f1-12749e4dcae3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "cinder-quobyte-d50ba497-4448-4064-87f1-12749e4dcae3" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-d50ba497-4448-4064-87f1-12749e4dcae3" acquired by "delete_volume" :: waited 0.014s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[40153ca3-f1f8-4a4b-83be-d8baa257753b]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028" returned: 0 in 0.375s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 1G Sep 01 02:23:35 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 Sep 01 02:23:35 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3" returned: 0 in 0.381s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3 Sep 01 02:23:35 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 1G" returned: 0 in 0.414s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eba357c-1eb8-464a-86ef-1ea962a96028 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eba357c-1eb8-464a-86ef-1ea962a96028 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 Sep 01 02:23:35 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-d50ba497-4448-4064-87f1-12749e4dcae3" returned: 0 in 0.262s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-quobyte-d50ba497-4448-4064-87f1-12749e4dcae3" released by "delete_volume" :: held 0.704s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Created reservations ['434cf17e-1499-46bf-854a-69c2478438be', 'bad7c319-3d32-48b7-b77f-7c67b8369c55', '3abab424-3e39-4c8d-8c0f-0a4010debe10', '199951a7-6571-45bb-b8ea-3b69281cae4e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:35 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8eba357c-1eb8-464a-86ef-1ea962a96028 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16" returned: 0 in 0.325s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:35 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 is being set with open permissions: ugo+rw Sep 01 02:23:35 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:35 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:35 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:35 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 Sep 01 02:23:35 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:36 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.258s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:36 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:36 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Deleted volume successfully. Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16" returned: 0 in 0.264s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2dc58bc3-9be1-4acc-bd1a-54d51f0f5a09 tempest-ProjectReaderTests-1417274899 None] Lock "cinder-d50ba497-4448-4064-87f1-12749e4dcae3-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:36 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.info Sep 01 02:23:36 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:36 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.info" returned: 0 in 0.265s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:36 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.info is being set with open permissions: ugo+rw Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:36 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.info Sep 01 02:23:36 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:36 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.info" returned: 0 in 0.248s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.978s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:36 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-7b982aae-34b1-4c2d-b150-3e246331a90b tempest-ProjectMemberTests-485697174 None] Create snapshot completed successfully Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-dd7687c3-1ef4-464b-b70f-9a3dd437aa16-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Lock "cinder-dd7687c3-1ef4-464b-b70f-9a3dd437aa16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-8eba357c-1eb8-464a-86ef-1ea962a96028" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-8eba357c-1eb8-464a-86ef-1ea962a96028" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-dd7687c3-1ef4-464b-b70f-9a3dd437aa16" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-dd7687c3-1ef4-464b-b70f-9a3dd437aa16" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Deleting offline snapshot dd7687c3-1ef4-464b-b70f-9a3dd437aa16 of volume 8eba357c-1eb8-464a-86ef-1ea962a96028 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] snapshot_file for this snap is: volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dfe4f4-1d72-4f42-ae55-be592ed425db]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:36 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:37 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 Sep 01 02:23:37 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:37 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16" returned: 0 in 0.384s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:37 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8eba357c-1eb8-464a-86ef-1ea962a96028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:37 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40f4d80-6f9a-487e-ab7b-1b224fb8f58e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:37 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 Sep 01 02:23:37 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:37 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028" returned: 0 in 0.402s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:37 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:37 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 Sep 01 02:23:37 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:38 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16" returned: 0 in 0.357s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:38 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16 Sep 01 02:23:38 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:38 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:38 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028.dd7687c3-1ef4-464b-b70f-9a3dd437aa16" returned: 0 in 0.263s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:38 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-dd7687c3-1ef4-464b-b70f-9a3dd437aa16" released by "_delete_snapshot" :: held 1.509s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:38 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-8eba357c-1eb8-464a-86ef-1ea962a96028" released by "delete_snapshot" :: held 1.534s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:38 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=180,cinder:INSERT=54,cinder:UPDATE=209,cinder:DELETE=16 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:23:38 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=166,cinder:UPDATE=218,cinder:DELETE=21,cinder:INSERT=63 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:23:38 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Created reservations ['8a32487e-f46b-4226-be36-13f020f1b8c6', 'b77f2468-7e35-4ee2-a787-ba3940d1cf41', 'f2958f47-a071-45b0-b200-8b1f89138d4d', '7b7592f0-b1df-42f7-b98e-e3257b22136b'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:38 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Delete snapshot completed successfully. Sep 01 02:23:38 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-596e0adc-7e71-4dfa-87d6-4c1fbe6b3310 tempest-ProjectMemberTests-485697174 None] Lock "cinder-dd7687c3-1ef4-464b-b70f-9a3dd437aa16-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-8eba357c-1eb8-464a-86ef-1ea962a96028-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Lock "cinder-8eba357c-1eb8-464a-86ef-1ea962a96028-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-8eba357c-1eb8-464a-86ef-1ea962a96028" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-8eba357c-1eb8-464a-86ef-1ea962a96028" acquired by "delete_volume" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:39 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c48ff4-487b-456e-a49d-58e20076762e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:39 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 Sep 01 02:23:39 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:39 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028" returned: 0 in 0.445s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:39 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028 Sep 01 02:23:39 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:39 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:39 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-8eba357c-1eb8-464a-86ef-1ea962a96028" returned: 0 in 0.297s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:39 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-8eba357c-1eb8-464a-86ef-1ea962a96028" released by "delete_volume" :: held 0.815s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Created reservations ['661f4f19-2817-48a5-b388-320f177bdd36', '73fc0de4-ff2c-4e4b-b0c1-eb58d3d0665e', '86dc7836-34a2-4198-97e0-087cfb619435', 'c83831d5-d056-4b74-be46-dcb43346672d'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:40 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:40 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:40 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.277s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:40 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Deleted volume successfully. Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-c996d0b5-31ec-4de2-b3e8-b53346e2975d tempest-ProjectMemberTests-485697174 None] Lock "cinder-8eba357c-1eb8-464a-86ef-1ea962a96028-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (253fc820-d26f-4907-bbe2-47bd598396de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c26da4-292f-4ace-bc06-43633ab1c82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c26da4-292f-4ace-bc06-43633ab1c82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703547366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6ba395-7ce5-4acc-a14b-1fb05f083789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:41Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7491eae-3e52-40a3-88ca-7102fb8afc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7491eae-3e52-40a3-88ca-7102fb8afc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a41e2c-fb9f-460e-9eb8-feb1b5a7bf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a41e2c-fb9f-460e-9eb8-feb1b5a7bf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa6ba395-7ce5-4acc-a14b-1fb05f083789', 'volume_name': 'volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c18d600-aad3-41d5-a4f6-abe5757bacd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c18d600-aad3-41d5-a4f6-abe5757bacd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab28417-d202-46ff-8647-8570980b037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:40 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Volume aa6ba395-7ce5-4acc-a14b-1fb05f083789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789', 'volume_size': 1} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-703547366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa6ba395-7ce5-4acc-a14b-1fb05f083789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:41Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Creating volume aa6ba395-7ce5-4acc-a14b-1fb05f083789 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:40 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:40 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:40 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 1073741824 Sep 01 02:23:40 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:41 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 1073741824" returned: 0 in 0.442s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:41 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 Sep 01 02:23:41 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:41 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789" returned: 0 in 0.269s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:41 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:41 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab28417-d202-46ff-8647-8570980b037e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0b119f-c9a8-4891-a29a-ff088201f6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:41 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Volume volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 (aa6ba395-7ce5-4acc-a14b-1fb05f083789): created successfully Sep 01 02:23:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0b119f-c9a8-4891-a29a-ff088201f6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:41 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (253fc820-d26f-4907-bbe2-47bd598396de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:41 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6a60ccab-0dff-4550-bc92-25f95bee0cf6 tempest-ProjectMemberTests-485697174 None] Created volume successfully. Sep 01 02:23:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:42 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] Creating offline snapshot d4451533-50d4-483a-b087-94765958e7ca of volume aa6ba395-7ce5-4acc-a14b-1fb05f083789 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:42 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[1221135e-4096-4fd8-b010-30a0478e928e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:42 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 Sep 01 02:23:42 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:42 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789" returned: 0 in 0.383s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:42 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca 1G Sep 01 02:23:42 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:42 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca 1G" returned: 0 in 0.409s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:42 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:42 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca Sep 01 02:23:42 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:43 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca" returned: 0 in 0.287s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:43 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca is being set with open permissions: ugo+rw Sep 01 02:23:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:43 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca Sep 01 02:23:43 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:43 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca" returned: 0 in 0.249s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:43 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.info Sep 01 02:23:43 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:43 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.info" returned: 0 in 0.272s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:43 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.info is being set with open permissions: ugo+rw Sep 01 02:23:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:43 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.info Sep 01 02:23:43 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:43 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.info" returned: 0 in 0.249s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:43 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:43 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f902466e-cf18-452b-b71b-ed123dfabe07 tempest-ProjectMemberTests-485697174 None] Create snapshot completed successfully Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-d4451533-50d4-483a-b087-94765958e7ca-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Lock "cinder-d4451533-50d4-483a-b087-94765958e7ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-aa6ba395-7ce5-4acc-a14b-1fb05f083789" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-aa6ba395-7ce5-4acc-a14b-1fb05f083789" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-d4451533-50d4-483a-b087-94765958e7ca" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-d4451533-50d4-483a-b087-94765958e7ca" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Deleting offline snapshot d4451533-50d4-483a-b087-94765958e7ca of volume aa6ba395-7ce5-4acc-a14b-1fb05f083789 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] snapshot_file for this snap is: volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c0429b-6bdf-464b-ab96-618eb0573a69]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:44 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca Sep 01 02:23:44 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:44 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca" returned: 0 in 0.427s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8c8e8d-4a5a-476a-91d0-ea7c6703856a]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:44 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:44 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 Sep 01 02:23:44 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:45 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789" returned: 0 in 0.389s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:45 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca Sep 01 02:23:45 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:45 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca" returned: 0 in 0.368s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:45 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca Sep 01 02:23:45 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:45 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:45 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789.d4451533-50d4-483a-b087-94765958e7ca" returned: 0 in 0.264s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-d4451533-50d4-483a-b087-94765958e7ca" released by "_delete_snapshot" :: held 1.549s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-aa6ba395-7ce5-4acc-a14b-1fb05f083789" released by "delete_snapshot" :: held 1.572s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:45 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Created reservations ['8b240abd-58b5-4ba7-ab67-6a6b66350891', '9e112ea8-4b11-4201-8b32-3f62f86d4151', 'ed2c5064-d3a9-4440-a06d-6f5b49257d3e', '091352ce-52cd-4069-80ef-baae5d5b0737'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:45 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Delete snapshot completed successfully. Sep 01 02:23:45 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4e33419e-5d65-472e-b021-197c8ae04357 tempest-ProjectMemberTests-485697174 None] Lock "cinder-d4451533-50d4-483a-b087-94765958e7ca-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-aa6ba395-7ce5-4acc-a14b-1fb05f083789-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Lock "cinder-aa6ba395-7ce5-4acc-a14b-1fb05f083789-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-aa6ba395-7ce5-4acc-a14b-1fb05f083789" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:46 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-aa6ba395-7ce5-4acc-a14b-1fb05f083789" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:46 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c766f1-b3b0-4d58-a84a-dac9fde00395]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:46 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 Sep 01 02:23:46 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:46 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789" returned: 0 in 0.382s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:46 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:46 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789 Sep 01 02:23:46 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:47 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-aa6ba395-7ce5-4acc-a14b-1fb05f083789" returned: 0 in 0.246s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-aa6ba395-7ce5-4acc-a14b-1fb05f083789" released by "delete_volume" :: held 0.695s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Created reservations ['67991ec1-6ca2-4793-8581-784de2cf09c9', 'bfe13055-ef4f-4c89-9866-ddcd6ff43ece', '83b8d53d-261f-4791-8345-65010f7c8f0e', 'c2a60abd-0f9b-47b9-9072-3f0b8e384fea'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:47 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:47 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:47 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:47 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:47 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.312s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:47 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Deleted volume successfully. Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a72b82a4-2534-48d6-a535-cd656f690675 tempest-ProjectMemberTests-485697174 None] Lock "cinder-aa6ba395-7ce5-4acc-a14b-1fb05f083789-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:47 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.307s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_service.periodic_task [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] Running periodic task VolumeManager._thread_info {{(pid=87389) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread count: 28 {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-dff19c57-6a8a-4bb9-aaf1-2fcab7af45bd None None] thread info: [<_MainThread(MainThread, started 133216952856704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87389) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Flow 'volume_create_manager' (bbdde3bf-d022-469c-9954-541ae34e3699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9bbf55-a186-4a8c-b046-92d0dd754c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d9bbf55-a186-4a8c-b046-92d0dd754c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1755002818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4885e1f8-a590-4488-97da-78c323d4afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490d1611259f43d3aef842a7fd13407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:48Z,use_quota=True,user_id='20bebc1003804ea3bc5ad039a26d48cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fc7cb3-7808-400b-8346-4b8d978f0149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7fc7cb3-7808-400b-8346-4b8d978f0149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d83615-708c-4cf3-a115-b4e20aec5b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d83615-708c-4cf3-a115-b4e20aec5b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4885e1f8-a590-4488-97da-78c323d4afc0', 'volume_name': 'volume-4885e1f8-a590-4488-97da-78c323d4afc0', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf6c305-3e4f-4f2a-acd3-3e1b3fecc84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf6c305-3e4f-4f2a-acd3-3e1b3fecc84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb4aaaf-7a19-458a-871e-4e8d5871fd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:47 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Volume 4885e1f8-a590-4488-97da-78c323d4afc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4885e1f8-a590-4488-97da-78c323d4afc0', 'volume_size': 1} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1755002818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4885e1f8-a590-4488-97da-78c323d4afc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490d1611259f43d3aef842a7fd13407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:48Z,use_quota=True,user_id='20bebc1003804ea3bc5ad039a26d48cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Creating volume 4885e1f8-a590-4488-97da-78c323d4afc0 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:47 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:47 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:47 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0 1073741824 Sep 01 02:23:47 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (ef55a363-0b5a-411a-8740-32b9a5435c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fa4eb5-add7-4d41-9ea4-d2dd46d5a259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6fa4eb5-add7-4d41-9ea4-d2dd46d5a259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1900432608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21845745-c5d0-4835-9ae6-6f1d598e955f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:48Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec83e9c1-5c73-4d99-82ac-76c24c741086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec83e9c1-5c73-4d99-82ac-76c24c741086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad22bc7e-5ef5-485e-82f7-708d695eb387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad22bc7e-5ef5-485e-82f7-708d695eb387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21845745-c5d0-4835-9ae6-6f1d598e955f', 'volume_name': 'volume-21845745-c5d0-4835-9ae6-6f1d598e955f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eddf15a-b115-4a58-992b-ac0b4efd8b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eddf15a-b115-4a58-992b-ac0b4efd8b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c1e15a-0181-4ee2-8367-7efa396af006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Volume 21845745-c5d0-4835-9ae6-6f1d598e955f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21845745-c5d0-4835-9ae6-6f1d598e955f', 'volume_size': 1} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:48 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0 1073741824" returned: 0 in 0.439s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:48 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0 Sep 01 02:23:48 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:48 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0" returned: 0 in 0.265s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.415s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1900432608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21845745-c5d0-4835-9ae6-6f1d598e955f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:48Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Creating volume 21845745-c5d0-4835-9ae6-6f1d598e955f {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:48 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:48 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f 1073741824 Sep 01 02:23:48 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb4aaaf-7a19-458a-871e-4e8d5871fd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4885e1f8-a590-4488-97da-78c323d4afc0', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff828c1e-229a-4b61-b9ca-6b3f245524f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:48 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Volume volume-4885e1f8-a590-4488-97da-78c323d4afc0 (4885e1f8-a590-4488-97da-78c323d4afc0): created successfully Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff828c1e-229a-4b61-b9ca-6b3f245524f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Flow 'volume_create_manager' (bbdde3bf-d022-469c-9954-541ae34e3699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:48 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3833cf90-4192-41a6-9151-7b627733e287 tempest-ProjectReaderTests-325453239 None] Created volume successfully. Sep 01 02:23:48 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f 1073741824" returned: 0 in 0.399s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:48 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:48 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f Sep 01 02:23:48 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:49 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f" returned: 0 in 0.259s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c1e15a-0181-4ee2-8367-7efa396af006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21845745-c5d0-4835-9ae6-6f1d598e955f', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2eda79c-8918-4e91-accf-8e4a70829dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:49 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Volume volume-21845745-c5d0-4835-9ae6-6f1d598e955f (21845745-c5d0-4835-9ae6-6f1d598e955f): created successfully Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2eda79c-8918-4e91-accf-8e4a70829dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (ef55a363-0b5a-411a-8740-32b9a5435c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:49 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-fe6cb4d1-7f13-4c0d-912b-6a4c6fe7cf76 tempest-ProjectMemberTests-485697174 None] Created volume successfully. Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Acquiring lock "cinder-4885e1f8-a590-4488-97da-78c323d4afc0-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Lock "cinder-4885e1f8-a590-4488-97da-78c323d4afc0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Acquiring lock "cinder-quobyte-4885e1f8-a590-4488-97da-78c323d4afc0" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Lock "cinder-quobyte-4885e1f8-a590-4488-97da-78c323d4afc0" acquired by "delete_volume" :: waited 0.013s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[395606c8-f144-4d87-9ac8-d1d2d956dbcf]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:49 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0 Sep 01 02:23:50 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] Creating offline snapshot 60e6d6a3-c65b-4265-8a05-d310cab74adb of volume 21845745-c5d0-4835-9ae6-6f1d598e955f {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb111e49-658e-4eeb-971d-679aab8f1fb9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0" returned: 0 in 0.399s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0 Sep 01 02:23:50 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:50 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f Sep 01 02:23:50 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:50 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-4885e1f8-a590-4488-97da-78c323d4afc0" returned: 0 in 0.245s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Lock "cinder-quobyte-4885e1f8-a590-4488-97da-78c323d4afc0" released by "delete_volume" :: held 0.683s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Created reservations ['711c9a78-0b0e-4696-9677-f4fa6f557410', '0a199905-7155-472e-89fd-c448778ea908', 'be0dcf88-7377-456d-9cb1-d39af568b5cf', '1cd07921-de83-4717-9956-6321b7e19cf1'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:50 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f" returned: 0 in 0.389s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:50 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb 1G Sep 01 02:23:50 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:50 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:50 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:50 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.246s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:50 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Deleted volume successfully. Sep 01 02:23:50 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-3c4e90cd-d75a-4164-98fe-ebc15f28d92f tempest-ProjectReaderTests-325453239 None] Lock "cinder-4885e1f8-a590-4488-97da-78c323d4afc0-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:51 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb 1G" returned: 0 in 0.442s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21845745-c5d0-4835-9ae6-6f1d598e955f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:51 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21845745-c5d0-4835-9ae6-6f1d598e955f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb Sep 01 02:23:51 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:51 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Flow 'volume_create_manager' (9380ae0d-0d6e-45c7-ab2e-46b8f9c4dec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfa45f4-e2b1-48b5-8449-11b644fac9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21845745-c5d0-4835-9ae6-6f1d598e955f -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb" returned: 0 in 0.346s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:51 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb is being set with open permissions: ugo+rw Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:51 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb Sep 01 02:23:51 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfa45f4-e2b1-48b5-8449-11b644fac9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1732360417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86dd2e5f-e22c-4240-a405-e5b9a9938147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490d1611259f43d3aef842a7fd13407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:51Z,use_quota=True,user_id='20bebc1003804ea3bc5ad039a26d48cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d09ceb-a547-4393-b0a0-d3165d39a1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d09ceb-a547-4393-b0a0-d3165d39a1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f32aea8-480b-4152-a8e6-67ea9f206631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f32aea8-480b-4152-a8e6-67ea9f206631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86dd2e5f-e22c-4240-a405-e5b9a9938147', 'volume_name': 'volume-86dd2e5f-e22c-4240-a405-e5b9a9938147', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832ac484-8d05-4229-991c-260340408c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (832ac484-8d05-4229-991c-260340408c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8595cb01-6843-4940-8ebc-388711db5552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:51 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Volume 86dd2e5f-e22c-4240-a405-e5b9a9938147: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86dd2e5f-e22c-4240-a405-e5b9a9938147', 'volume_size': 1} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:51 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb" returned: 0 in 0.250s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:51 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.info Sep 01 02:23:51 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:51 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.info" returned: 0 in 0.243s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:51 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.info is being set with open permissions: ugo+rw Sep 01 02:23:51 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:52 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.info Sep 01 02:23:52 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.info" returned: 0 in 0.254s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.013s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1732360417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86dd2e5f-e22c-4240-a405-e5b9a9938147,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490d1611259f43d3aef842a7fd13407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:51Z,use_quota=True,user_id='20bebc1003804ea3bc5ad039a26d48cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Creating volume 86dd2e5f-e22c-4240-a405-e5b9a9938147 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:52 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:52 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147 1073741824 Sep 01 02:23:52 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-26ee75e7-5e4b-4aa4-a252-e44b8085e026 tempest-ProjectMemberTests-485697174 None] Create snapshot completed successfully Sep 01 02:23:52 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147 1073741824" returned: 0 in 0.411s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:52 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147 Sep 01 02:23:52 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:52 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147" returned: 0 in 0.235s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8595cb01-6843-4940-8ebc-388711db5552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86dd2e5f-e22c-4240-a405-e5b9a9938147', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e361c41b-d3ce-47d3-b1fe-cb65fd32ffc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:52 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Volume volume-86dd2e5f-e22c-4240-a405-e5b9a9938147 (86dd2e5f-e22c-4240-a405-e5b9a9938147): created successfully Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e361c41b-d3ce-47d3-b1fe-cb65fd32ffc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:52 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Flow 'volume_create_manager' (9380ae0d-0d6e-45c7-ab2e-46b8f9c4dec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:53 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-c6502ac9-03e1-49d5-a2b0-4cb814e04f70 tempest-ProjectReaderTests-325453239 None] Created volume successfully. Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-60e6d6a3-c65b-4265-8a05-d310cab74adb-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Lock "cinder-60e6d6a3-c65b-4265-8a05-d310cab74adb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-21845745-c5d0-4835-9ae6-6f1d598e955f" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-21845745-c5d0-4835-9ae6-6f1d598e955f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-60e6d6a3-c65b-4265-8a05-d310cab74adb" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-60e6d6a3-c65b-4265-8a05-d310cab74adb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Deleting offline snapshot 60e6d6a3-c65b-4265-8a05-d310cab74adb of volume 21845745-c5d0-4835-9ae6-6f1d598e955f {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] snapshot_file for this snap is: volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49d223c-53ee-4e61-9276-c3156c8c5f7f]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Acquiring lock "cinder-86dd2e5f-e22c-4240-a405-e5b9a9938147-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Lock "cinder-86dd2e5f-e22c-4240-a405-e5b9a9938147-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Acquiring lock "cinder-quobyte-86dd2e5f-e22c-4240-a405-e5b9a9938147" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Lock "cinder-quobyte-86dd2e5f-e22c-4240-a405-e5b9a9938147" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:53 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb Sep 01 02:23:53 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48315ac-dd16-4660-bcf5-b3a38a969235]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:53 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147 Sep 01 02:23:53 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:53 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb" returned: 0 in 0.398s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21845745-c5d0-4835-9ae6-6f1d598e955f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[874b8389-cd49-4992-841b-29c33558bd2c]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:53 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:54 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f Sep 01 02:23:54 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:54 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147" returned: 0 in 0.373s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:54 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147 Sep 01 02:23:54 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:54 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-86dd2e5f-e22c-4240-a405-e5b9a9938147" returned: 0 in 0.243s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:54 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f" returned: 0 in 0.382s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Lock "cinder-quobyte-86dd2e5f-e22c-4240-a405-e5b9a9938147" released by "delete_volume" :: held 0.669s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:54 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb Sep 01 02:23:54 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Created reservations ['60215d2f-d38f-4ca5-9221-701ac3c7e54f', 'c6f680be-fc5f-43c4-bdc8-9842069ae4ae', '910940ab-6ad5-4496-89ee-978d6c70ad10', 'ac52e5c7-6d1d-4d73-8ae8-d78d5689a01e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:54 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:54 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:54 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb" returned: 0 in 0.366s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:54 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb Sep 01 02:23:54 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:54 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.262s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:54 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Deleted volume successfully. Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-2939ad64-43f3-4bda-b068-54759de9f5ef tempest-ProjectReaderTests-325453239 None] Lock "cinder-86dd2e5f-e22c-4240-a405-e5b9a9938147-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:54 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:54 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f.60e6d6a3-c65b-4265-8a05-d310cab74adb" returned: 0 in 0.261s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-60e6d6a3-c65b-4265-8a05-d310cab74adb" released by "_delete_snapshot" :: held 1.535s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-21845745-c5d0-4835-9ae6-6f1d598e955f" released by "delete_snapshot" :: held 1.567s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Created reservations ['03ffb5f3-5927-481d-8e5d-14048023c66d', '8c6f3aa5-60af-4cf3-b1b6-b41b19cbd2a2', '78193df9-904f-4348-8dd7-a888224489f7', 'da967c07-026a-4b47-b318-43b5834ff7f6'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:55 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Delete snapshot completed successfully. Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-8a400f96-fc33-4cc7-adc4-68b57f36c54e tempest-ProjectMemberTests-485697174 None] Lock "cinder-60e6d6a3-c65b-4265-8a05-d310cab74adb-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Flow 'volume_create_manager' (ae04f641-bf6a-4590-ac0e-7653b481a1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b71e36a-fc40-4b2b-99e8-b0772a0d8d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b71e36a-fc40-4b2b-99e8-b0772a0d8d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723280236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e33a17a-ae2b-419c-9313-30463ef47649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490d1611259f43d3aef842a7fd13407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:55Z,use_quota=True,user_id='20bebc1003804ea3bc5ad039a26d48cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ffba06-5eb0-4c31-86e5-3b97d0f915c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9ffba06-5eb0-4c31-86e5-3b97d0f915c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461294f0-db63-434f-a927-0c12b4abc66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461294f0-db63-434f-a927-0c12b4abc66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e33a17a-ae2b-419c-9313-30463ef47649', 'volume_name': 'volume-9e33a17a-ae2b-419c-9313-30463ef47649', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c05c2e8-67fa-4c1d-8efb-601f657b8da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c05c2e8-67fa-4c1d-8efb-601f657b8da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d19680-e3ef-4d7b-a5fb-3d529f23e14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:55 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Volume 9e33a17a-ae2b-419c-9313-30463ef47649: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e33a17a-ae2b-419c-9313-30463ef47649', 'volume_size': 1} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723280236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e33a17a-ae2b-419c-9313-30463ef47649,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490d1611259f43d3aef842a7fd13407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:55Z,use_quota=True,user_id='20bebc1003804ea3bc5ad039a26d48cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Creating volume 9e33a17a-ae2b-419c-9313-30463ef47649 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:55 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:55 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649 1073741824 Sep 01 02:23:55 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-21845745-c5d0-4835-9ae6-6f1d598e955f-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Lock "cinder-21845745-c5d0-4835-9ae6-6f1d598e955f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-21845745-c5d0-4835-9ae6-6f1d598e955f" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-21845745-c5d0-4835-9ae6-6f1d598e955f" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77b6564-0255-494c-8337-8df0b8eead50]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:55 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649 1073741824" returned: 0 in 0.463s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:55 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:55 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f Sep 01 02:23:55 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:55 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649 Sep 01 02:23:55 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:56 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649" returned: 0 in 0.250s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:56 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55d19680-e3ef-4d7b-a5fb-3d529f23e14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e33a17a-ae2b-419c-9313-30463ef47649', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3739b7-b08d-4a8b-b98e-baa6cc32f914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f" returned: 0 in 0.378s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:56 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Volume volume-9e33a17a-ae2b-419c-9313-30463ef47649 (9e33a17a-ae2b-419c-9313-30463ef47649): created successfully Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3739b7-b08d-4a8b-b98e-baa6cc32f914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:56 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f Sep 01 02:23:56 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Flow 'volume_create_manager' (ae04f641-bf6a-4590-ac0e-7653b481a1da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:56 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-934b208c-f6c5-479a-b888-85aff3377a2c tempest-ProjectReaderTests-325453239 None] Created volume successfully. Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Acquiring lock "cinder-9e33a17a-ae2b-419c-9313-30463ef47649-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Lock "cinder-9e33a17a-ae2b-419c-9313-30463ef47649-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:56 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-21845745-c5d0-4835-9ae6-6f1d598e955f" returned: 0 in 0.271s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-21845745-c5d0-4835-9ae6-6f1d598e955f" released by "delete_volume" :: held 0.709s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Acquiring lock "cinder-quobyte-9e33a17a-ae2b-419c-9313-30463ef47649" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Lock "cinder-quobyte-9e33a17a-ae2b-419c-9313-30463ef47649" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[932c3095-21c5-47ca-be3e-e7eee46c73d9]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Created reservations ['167f5c14-cd50-41a5-906d-5750c4f82d54', '246c4dba-6b23-45bd-8c8f-55c4297c109a', 'a15606d0-be78-4d87-ae6f-5ed9925ba6c0', '74a2b068-1d1b-4944-9df3-d74ac1aab5c0'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:56 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649 Sep 01 02:23:56 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:56 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:56 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:56 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.290s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:56 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649" returned: 0 in 0.412s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:56 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Deleted volume successfully. Sep 01 02:23:56 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649 Sep 01 02:23:56 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:56 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-def23ecb-bf91-4f68-a2e1-6e94c9d7ccfc tempest-ProjectMemberTests-485697174 None] Lock "cinder-21845745-c5d0-4835-9ae6-6f1d598e955f-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:57 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-9e33a17a-ae2b-419c-9313-30463ef47649" returned: 0 in 0.273s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Lock "cinder-quobyte-9e33a17a-ae2b-419c-9313-30463ef47649" released by "delete_volume" :: held 0.728s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Created reservations ['620a4cc4-74b1-4387-8794-f09f402cc4f0', 'f19f223a-b3a8-428c-b00d-c3a15b35df67', '5918beda-3858-42d4-8815-519820f2a80e', '3bf0b47e-8451-4017-92e6-6ae60af41c68'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:57 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:57 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (21cf1136-3912-47c7-abff-b9649354acf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffe9445-ca22-45cc-bdfe-2737334a2a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ffe9445-ca22-45cc-bdfe-2737334a2a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1706560999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837ad851-a87f-4a57-a049-56c8189280c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:57Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51629b9-38a3-4ae8-9413-d83df0cd1946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a51629b9-38a3-4ae8-9413-d83df0cd1946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ee9041-59aa-496e-959a-c5e86d030223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ee9041-59aa-496e-959a-c5e86d030223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837ad851-a87f-4a57-a049-56c8189280c1', 'volume_name': 'volume-837ad851-a87f-4a57-a049-56c8189280c1', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09ebf4f-d803-44cd-9ba3-d2df3cb9f01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09ebf4f-d803-44cd-9ba3-d2df3cb9f01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd616ed6-bdc0-4b2f-9555-fb2f29879993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:57 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Volume 837ad851-a87f-4a57-a049-56c8189280c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837ad851-a87f-4a57-a049-56c8189280c1', 'volume_size': 1} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1706560999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837ad851-a87f-4a57-a049-56c8189280c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc411683b4a0415eb4c93a0644265526',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:57Z,use_quota=True,user_id='43b09b9a0c7d49a3a0d4ab7368fbcf9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Creating volume 837ad851-a87f-4a57-a049-56c8189280c1 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:57 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:57 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 1073741824 Sep 01 02:23:57 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:57 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.282s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:23:57 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Deleted volume successfully. Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-55b9764a-a234-4147-b520-2d5e5cd2a2d8 tempest-ProjectReaderTests-325453239 None] Lock "cinder-9e33a17a-ae2b-419c-9313-30463ef47649-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:57 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 1073741824" returned: 0 in 0.462s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:57 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:57 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 Sep 01 02:23:57 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Flow 'volume_create_manager' (f1e103f5-af3c-49d4-92f3-772bc3f98a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf66475-aa88-41c2-8b04-97ed37f2abce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf66475-aa88-41c2-8b04-97ed37f2abce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477972850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951b11a6-953e-4d19-935e-6f8bfdb2ad64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490d1611259f43d3aef842a7fd13407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:58Z,use_quota=True,user_id='20bebc1003804ea3bc5ad039a26d48cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aeee956-b0ec-41b4-a836-63de92ca2e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aeee956-b0ec-41b4-a836-63de92ca2e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95477470-3eba-4d97-8f67-1064b1d4e152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95477470-3eba-4d97-8f67-1064b1d4e152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '951b11a6-953e-4d19-935e-6f8bfdb2ad64', 'volume_name': 'volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e585ec18-6a81-4604-906c-fb6767dff65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e585ec18-6a81-4604-906c-fb6767dff65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0836a486-6a9b-4092-9235-27a2e633881a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:58 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Volume 951b11a6-953e-4d19-935e-6f8bfdb2ad64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64', 'volume_size': 1} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:58 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1" returned: 0 in 0.267s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477972850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=951b11a6-953e-4d19-935e-6f8bfdb2ad64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='490d1611259f43d3aef842a7fd13407a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:23:58Z,use_quota=True,user_id='20bebc1003804ea3bc5ad039a26d48cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Creating volume 951b11a6-953e-4d19-935e-6f8bfdb2ad64 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:23:58 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd616ed6-bdc0-4b2f-9555-fb2f29879993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837ad851-a87f-4a57-a049-56c8189280c1', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:58 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64 1073741824 Sep 01 02:23:58 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b454bf9-cb1c-4813-8d6a-3dd5d0cbb5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:58 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Volume volume-837ad851-a87f-4a57-a049-56c8189280c1 (837ad851-a87f-4a57-a049-56c8189280c1): created successfully Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b454bf9-cb1c-4813-8d6a-3dd5d0cbb5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Flow 'volume_create_manager' (21cf1136-3912-47c7-abff-b9649354acf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:58 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-090b5304-2d3c-4012-87f3-1992c13c0308 tempest-ProjectMemberTests-485697174 None] Created volume successfully. Sep 01 02:23:58 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64 1073741824" returned: 0 in 0.425s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:58 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64 Sep 01 02:23:58 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:58 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64" returned: 0 in 0.239s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0836a486-6a9b-4092-9235-27a2e633881a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f457bb96-5d77-470e-b01b-a4fed718e10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:23:58 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Volume volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64 (951b11a6-953e-4d19-935e-6f8bfdb2ad64): created successfully Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f457bb96-5d77-470e-b01b-a4fed718e10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:23:58 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Flow 'volume_create_manager' (f1e103f5-af3c-49d4-92f3-772bc3f98a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:23:58 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-6f0b4c27-71c8-4ddc-8741-ba6052ce7a88 tempest-ProjectReaderTests-325453239 None] Created volume successfully. Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Acquiring lock "cinder-951b11a6-953e-4d19-935e-6f8bfdb2ad64-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Lock "cinder-951b11a6-953e-4d19-935e-6f8bfdb2ad64-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Acquiring lock "cinder-quobyte-951b11a6-953e-4d19-935e-6f8bfdb2ad64" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Lock "cinder-quobyte-951b11a6-953e-4d19-935e-6f8bfdb2ad64" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[d467c73b-5341-49a2-8d51-b420aff35bb2]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:59 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64 Sep 01 02:23:59 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] Creating offline snapshot e42aa6e6-7f35-496e-9c05-96f6649c25fa of volume 837ad851-a87f-4a57-a049-56c8189280c1 {{(pid=87389) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 01 02:23:59 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64" returned: 0 in 0.420s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c026e7-a854-4315-aa42-55556844dfbe]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:59 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64 Sep 01 02:23:59 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:59 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 Sep 01 02:23:59 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:23:59 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-951b11a6-953e-4d19-935e-6f8bfdb2ad64" returned: 0 in 0.259s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Lock "cinder-quobyte-951b11a6-953e-4d19-935e-6f8bfdb2ad64" released by "delete_volume" :: held 0.717s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Created reservations ['be99c5bb-4e0d-4cfa-a44a-a7cc2809e142', '0da6b30c-6bd6-4994-a63f-4784fae10b13', 'e6d943cb-acd4-4e1b-b27c-1d543d30042f', '3fefaad3-bc7d-45d4-8eac-0d1407582b4e'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:23:59 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1" returned: 0 in 0.402s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:23:59 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa 1G {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:23:59 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:23:59 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:00 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa 1G Sep 01 02:24:00 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:00 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.264s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:00 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:00 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Deleted volume successfully. Sep 01 02:24:00 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-e387908a-522d-4343-85ad-29632de5c2f5 tempest-ProjectReaderTests-325453239 None] Lock "cinder-951b11a6-953e-4d19-935e-6f8bfdb2ad64-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:00 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa 1G" returned: 0 in 0.462s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837ad851-a87f-4a57-a049-56c8189280c1 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:00 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837ad851-a87f-4a57-a049-56c8189280c1 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa Sep 01 02:24:00 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:00 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-837ad851-a87f-4a57-a049-56c8189280c1 -F qcow2 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa" returned: 0 in 0.297s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:00 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa is being set with open permissions: ugo+rw Sep 01 02:24:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:00 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa Sep 01 02:24:00 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:00 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:00 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa" returned: 0 in 0.255s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:01 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.info Sep 01 02:24:01 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:01 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.info" returned: 0 in 0.277s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:01 devstack cinder-volume[87389]: WARNING cinder.volume.drivers.remotefs [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.info is being set with open permissions: ugo+rw Sep 01 02:24:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.info {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:01 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.info Sep 01 02:24:01 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:01 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.info" returned: 0 in 0.290s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:01 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:01 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-643bb0ff-f3c9-44ec-a565-31fa1985337b tempest-ProjectMemberTests-485697174 None] Create snapshot completed successfully Sep 01 02:24:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-e42aa6e6-7f35-496e-9c05-96f6649c25fa-delete_snapshot" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Lock "cinder-e42aa6e6-7f35-496e-9c05-96f6649c25fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-837ad851-a87f-4a57-a049-56c8189280c1" by "delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-837ad851-a87f-4a57-a049-56c8189280c1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-e42aa6e6-7f35-496e-9c05-96f6649c25fa" by "_delete_snapshot" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:02 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-e42aa6e6-7f35-496e-9c05-96f6649c25fa" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Deleting offline snapshot e42aa6e6-7f35-496e-9c05-96f6649c25fa of volume 837ad851-a87f-4a57-a049-56c8189280c1 {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 01 02:24:02 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] snapshot_file for this snap is: volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa {{(pid=87389) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 01 02:24:02 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[e220d68e-9a32-4897-849d-301b7ceb104d]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:02 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:02 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa Sep 01 02:24:02 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:03 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa" returned: 0 in 0.358s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:03 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-837ad851-a87f-4a57-a049-56c8189280c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87389) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 01 02:24:03 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c8b673-b26a-4d6e-8db0-89ce08f009bf]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:03 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 Sep 01 02:24:03 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:03 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1" returned: 0 in 0.354s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:03 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa Sep 01 02:24:03 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:03 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa" returned: 0 in 0.330s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:03 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:03 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa Sep 01 02:24:03 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:04 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:04 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1.e42aa6e6-7f35-496e-9c05-96f6649c25fa" returned: 0 in 0.235s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-e42aa6e6-7f35-496e-9c05-96f6649c25fa" released by "_delete_snapshot" :: held 1.360s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-837ad851-a87f-4a57-a049-56c8189280c1" released by "delete_snapshot" :: held 1.381s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:04 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Created reservations ['95db66a1-a687-4a85-8228-f06c3ef07ef5', '0ecf314f-601a-4c3f-b7b6-f92acad5f375', 'bdb633cf-2477-4b95-a982-bde7ae790c39', '50d4d5c6-5fe5-4049-843d-17d18f0a7b30'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:04 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Delete snapshot completed successfully. Sep 01 02:24:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-b60b5ef3-6c9d-4c79-99fc-01c31624a5f8 tempest-ProjectMemberTests-485697174 None] Lock "cinder-e42aa6e6-7f35-496e-9c05-96f6649c25fa-delete_snapshot" released by "delete_snapshot" :: held 1.515s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-837ad851-a87f-4a57-a049-56c8189280c1-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Lock "cinder-837ad851-a87f-4a57-a049-56c8189280c1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Acquiring lock "cinder-quobyte-837ad851-a87f-4a57-a049-56c8189280c1" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:04 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-837ad851-a87f-4a57-a049-56c8189280c1" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9d8a77-1335-454e-a5a9-e9f227f8b8f1]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:05 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 Sep 01 02:24:05 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:05 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1" returned: 0 in 0.353s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:05 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1 Sep 01 02:24:05 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:05 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-837ad851-a87f-4a57-a049-56c8189280c1" returned: 0 in 0.241s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Lock "cinder-quobyte-837ad851-a87f-4a57-a049-56c8189280c1" released by "delete_volume" :: held 0.647s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Created reservations ['723bab0b-1088-4076-aaca-bb752b047ec7', 'e0069cf0-9717-4244-9bd8-654edc7366d1', 'd5c0bd6a-ee9c-465f-9b74-761fc0f1be57', 'd0accba0-2ea2-424c-b98c-66e3a6dafa28'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:05 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:24:05 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:05 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.223s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:05 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Deleted volume successfully. Sep 01 02:24:05 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-a630e00c-aef6-4545-9abd-d7c3cdee2a8e tempest-ProjectMemberTests-485697174 None] Lock "cinder-837ad851-a87f-4a57-a049-56c8189280c1-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Flow 'volume_create_manager' (c09dc529-e976-4bea-ae5c-5b7e989cf960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6afe2fc-b4f5-4389-9ed6-dbf95e3db181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6afe2fc-b4f5-4389-9ed6-dbf95e3db181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581867731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec91e738-269a-40a9-a2e1-c87cf2021acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af680a4c71c94e9981ff47eed85798f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:09Z,use_quota=True,user_id='5c437c5aa3c14ca4b95a16f4fc0b7d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90993adb-bb4d-43cd-b129-c43fbbc8e810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90993adb-bb4d-43cd-b129-c43fbbc8e810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e320fe-f5af-4252-8020-bf6d3e4bd5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5e320fe-f5af-4252-8020-bf6d3e4bd5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec91e738-269a-40a9-a2e1-c87cf2021acd', 'volume_name': 'volume-ec91e738-269a-40a9-a2e1-c87cf2021acd', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88835843-6142-45bd-a3ea-df560efcd56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88835843-6142-45bd-a3ea-df560efcd56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a50fe34-18fb-49d7-a462-896fcec45e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:09 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Volume ec91e738-269a-40a9-a2e1-c87cf2021acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec91e738-269a-40a9-a2e1-c87cf2021acd', 'volume_size': 1} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581867731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec91e738-269a-40a9-a2e1-c87cf2021acd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af680a4c71c94e9981ff47eed85798f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:09Z,use_quota=True,user_id='5c437c5aa3c14ca4b95a16f4fc0b7d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Creating volume ec91e738-269a-40a9-a2e1-c87cf2021acd {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:09 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:24:09 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:09 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd 1073741824 Sep 01 02:24:09 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:10 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd 1073741824" returned: 0 in 0.438s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:10 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd Sep 01 02:24:10 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:10 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd" returned: 0 in 0.247s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a50fe34-18fb-49d7-a462-896fcec45e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec91e738-269a-40a9-a2e1-c87cf2021acd', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515d6899-7b08-4603-886b-e1fbc5522129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:10 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Volume volume-ec91e738-269a-40a9-a2e1-c87cf2021acd (ec91e738-269a-40a9-a2e1-c87cf2021acd): created successfully Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (515d6899-7b08-4603-886b-e1fbc5522129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Flow 'volume_create_manager' (c09dc529-e976-4bea-ae5c-5b7e989cf960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:10 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-79dd19eb-6e8f-4124-abbb-5da8edc5e7cc tempest-ProjectReaderTests-111288388 None] Created volume successfully. Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Acquiring lock "cinder-ec91e738-269a-40a9-a2e1-c87cf2021acd-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Lock "cinder-ec91e738-269a-40a9-a2e1-c87cf2021acd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Acquiring lock "cinder-quobyte-ec91e738-269a-40a9-a2e1-c87cf2021acd" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Lock "cinder-quobyte-ec91e738-269a-40a9-a2e1-c87cf2021acd" acquired by "delete_volume" :: waited 0.015s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef5788b-6da5-4edf-8b95-9d65cdc2a4a6]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:10 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:10 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd Sep 01 02:24:10 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:11 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd" returned: 0 in 0.346s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:11 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd Sep 01 02:24:11 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:11 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-ec91e738-269a-40a9-a2e1-c87cf2021acd" returned: 0 in 0.234s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Lock "cinder-quobyte-ec91e738-269a-40a9-a2e1-c87cf2021acd" released by "delete_volume" :: held 0.626s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Created reservations ['d7457716-e58d-4e68-ba6d-667e8e9a7e40', '80383bef-5dff-45a3-8018-ec6db1f58098', 'a4376878-12ac-46b6-9619-f78faabbdffb', 'ee365ad3-0916-4f57-89b5-6fe3c4a9e76c'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:11 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:24:11 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:11 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.246s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:11 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Deleted volume successfully. Sep 01 02:24:11 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-4d8b40c5-aa8a-49d6-a481-c07fffa645c1 tempest-ProjectReaderTests-111288388 None] Lock "cinder-ec91e738-269a-40a9-a2e1-c87cf2021acd-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.flows.manager.create_volume [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87389) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Flow 'volume_create_manager' (d328b698-8374-44d9-83b4-4112a89dea35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475c8f0d-315e-46cc-a93d-1c8762a7a07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475c8f0d-315e-46cc-a93d-1c8762a7a07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2023612406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdb057a-1fd4-4001-96ad-356f74497357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af680a4c71c94e9981ff47eed85798f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:12Z,use_quota=True,user_id='5c437c5aa3c14ca4b95a16f4fc0b7d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1389f81c-6c03-4d8e-8883-9380e25a513e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1389f81c-6c03-4d8e-8883-9380e25a513e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c2cab3-e88f-4010-b339-a4b0c8462eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c2cab3-e88f-4010-b339-a4b0c8462eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bdb057a-1fd4-4001-96ad-356f74497357', 'volume_name': 'volume-6bdb057a-1fd4-4001-96ad-356f74497357', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034caf59-24ad-4f8f-8c72-1e9404102627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (034caf59-24ad-4f8f-8c72-1e9404102627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37cedce-fb9b-4456-8b3b-b1d7341bb3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:12 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Volume 6bdb057a-1fd4-4001-96ad-356f74497357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bdb057a-1fd4-4001-96ad-356f74497357', 'volume_size': 1} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-01T00:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2023612406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bdb057a-1fd4-4001-96ad-356f74497357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af680a4c71c94e9981ff47eed85798f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-01T00:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-01T00:24:12Z,use_quota=True,user_id='5c437c5aa3c14ca4b95a16f4fc0b7d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58bc4443-6058-4560-b8ff-90fd4c294722),volume_type_id=58bc4443-6058-4560-b8ff-90fd4c294722)}" {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.remotefs [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Creating volume 6bdb057a-1fd4-4001-96ad-356f74497357 {{(pid=87389) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Selected osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be as target Quobyte volume. {{(pid=87389) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 01 02:24:12 devstack cinder-volume[87389]: INFO cinder.volume.drivers.remotefs [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] casted to osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357 1073741824 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:12 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357 1073741824 Sep 01 02:24:12 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:12 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357 1073741824" returned: 0 in 0.415s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:12 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:12 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357 Sep 01 02:24:12 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:13 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357" returned: 0 in 0.260s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'} {{(pid=87389) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37cedce-fb9b-4456-8b3b-b1d7341bb3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bdb057a-1fd4-4001-96ad-356f74497357', 'volume_size': 1}' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1328b1b-0835-4c45-97e3-d407697e7ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 01 02:24:13 devstack cinder-volume[87389]: INFO cinder.volume.flows.manager.create_volume [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Volume volume-6bdb057a-1fd4-4001-96ad-356f74497357 (6bdb057a-1fd4-4001-96ad-356f74497357): created successfully Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1328b1b-0835-4c45-97e3-d407697e7ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87389) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Flow 'volume_create_manager' (d328b698-8374-44d9-83b4-4112a89dea35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87389) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 01 02:24:13 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-f156453f-6f73-4ba8-ab5f-0da3f9341064 tempest-ProjectReaderTests-111288388 None] Created volume successfully. Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Acquiring lock "cinder-6bdb057a-1fd4-4001-96ad-356f74497357-delete_volume" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Lock "cinder-6bdb057a-1fd4-4001-96ad-356f74497357-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Acquiring lock "cinder-quobyte-6bdb057a-1fd4-4001-96ad-356f74497357" by "delete_volume" {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Lock "cinder-quobyte-6bdb057a-1fd4-4001-96ad-356f74497357" acquired by "delete_volume" :: waited 0.013s {{(pid=87389) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG oslo.privsep.daemon [-] privsep: reply[885d594c-106e-4a30-adec-07390a37e83e]: (4, 'qcow2') {{(pid=88409) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:13 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357 Sep 01 02:24:13 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:13 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357" returned: 0 in 0.357s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:13 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:13 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357 Sep 01 02:24:13 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:14 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0/volume-6bdb057a-1fd4-4001-96ad-356f74497357" returned: 0 in 0.253s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Lock "cinder-quobyte-6bdb057a-1fd4-4001-96ad-356f74497357" released by "delete_volume" :: held 0.648s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG cinder.quota [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Created reservations ['a3a7ba37-5e13-46fb-93bb-8b4b0dcafb66', '0bb8083e-9b29-45ab-a58f-6dcdc10f6d86', '7496e3f2-8672-4d0a-8aa0-8edffca5c5d1', 'd128b1d4-5647-46d7-bc19-9086e4d8b41c'] {{(pid=87389) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be': None} {{(pid=87389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG cinder.volume.drivers.quobyte [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-8fc128ce-a1a4-4c0a-b780-5069ba14b2be'] {{(pid=87389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.lockutils [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 01 02:24:14 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0 Sep 01 02:24:14 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 01 02:24:14 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG oslo_concurrency.processutils [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aba79c69aa3972c2fcfe29b1e940baf0" returned: 0 in 0.255s {{(pid=87389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG cinder.manager [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Notifying Schedulers of capabilities ... {{(pid=87389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 01 02:24:14 devstack cinder-volume[87389]: INFO cinder.volume.manager [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Deleted volume successfully. Sep 01 02:24:14 devstack cinder-volume[87389]: DEBUG cinder.coordination [None req-bb3f3302-58e2-484d-bca5-291d5b2894ae tempest-ProjectReaderTests-111288388 None] Lock "cinder-6bdb057a-1fd4-4001-96ad-356f74497357-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87389) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 01 02:24:24 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:INSERT=36,cinder:UPDATE=133,cinder:SELECT=95,cinder:DELETE=15 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 01 02:24:24 devstack cinder-volume[87389]: DEBUG dbcounter [-] [87389] Writing DB stats cinder:SELECT=90,cinder:INSERT=32,cinder:UPDATE=134,cinder:DELETE=7 {{(pid=87389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}